Max level shown:
1 [ Nov 14 08:55:27 Enabled. ]
2 [ Nov 14 08:55:27 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 14 08:55:27 Method "start" exited with status 0. ]
4 [ Nov 14 08:55:27 Rereading configuration. ]
5 [ Nov 14 08:55:27 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-14T08:55:27.378ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-14T08:55:27.378ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-14T08:55:27.431ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-14T08:55:27.431ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-14T08:55:27.545ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-14T08:55:27.554ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-14T08:55:27.562ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-14T08:55:28.163ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-11-14T08:55:28.302ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-14T08:55:28.302ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-14T08:55:28.302ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-14T08:55:28.302ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-14T08:55:28.303ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-11-14T08:55:28.303ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-11-14T08:55:28.306ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-14T08:55:28.306ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-14T08:55:28.306ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-14T08:55:28.306ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-14T08:55:28.306ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-14T08:55:28.306ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-14T08:55:28.306ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-11-14T08:55:28.306ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-14T08:55:28.306ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-14T08:55:28.317ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-14T08:55:28.317ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 7b47c429-1e53-46e1-a6dc-8833bde95c8b (zpool)
322024-11-14T08:55:28.442ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 7b47c429-1e53-46e1-a6dc-8833bde95c8b (zpool), kind: Internal }
332024-11-14T08:55:28.998ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-11-14T08:55:28.998ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-14T08:55:28.998ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-14T08:55:28.998ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-14T08:55:28.998ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-11-14T08:55:28.998ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-14T08:55:28.998ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-14T08:55:29.007ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-14T08:55:29.007ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 6c1654e8-5949-490c-b293-edf8cb5a6332 (zpool)
422024-11-14T08:55:29.110ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 6c1654e8-5949-490c-b293-edf8cb5a6332 (zpool), kind: Internal }
432024-11-14T08:55:29.658ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-14T08:55:29.658ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7b47c429-1e53-46e1-a6dc-8833bde95c8b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c1654e8-5949-490c-b293-edf8cb5a6332 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-14T08:55:29.658ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-11-14T08:55:29.658ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-11-14T08:55:29.658ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
482024-11-14T08:55:29.658ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-11-14T08:55:29.658ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-14T08:55:29.658ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7b47c429-1e53-46e1-a6dc-8833bde95c8b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c1654e8-5949-490c-b293-edf8cb5a6332 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-11-14T08:55:29.658ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-11-14T08:55:29.658ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
532024-11-14T08:55:29.658ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
542024-11-14T08:55:29.658ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-11-14T08:55:29.658ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-14T08:55:29.658ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
572024-11-14T08:55:29.658ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7b47c429-1e53-46e1-a6dc-8833bde95c8b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c1654e8-5949-490c-b293-edf8cb5a6332 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
582024-11-14T08:55:29.658ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-11-14T08:55:29.658ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-11-14T08:55:29.658ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-11-14T08:55:29.658ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-14T08:55:29.658ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7b47c429-1e53-46e1-a6dc-8833bde95c8b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c1654e8-5949-490c-b293-edf8cb5a6332 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-11-14T08:55:29.658ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
642024-11-14T08:55:29.658ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652024-11-14T08:55:29.658ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-11-14T08:55:29.658ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-11-14T08:55:29.658ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-14T08:55:29.658ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7b47c429-1e53-46e1-a6dc-8833bde95c8b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c1654e8-5949-490c-b293-edf8cb5a6332 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-11-14T08:55:29.658ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-11-14T08:55:29.658ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-11-14T08:55:29.658ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
722024-11-14T08:55:29.658ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-11-14T08:55:29.658ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-14T08:55:29.658ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7b47c429-1e53-46e1-a6dc-8833bde95c8b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c1654e8-5949-490c-b293-edf8cb5a6332 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-11-14T08:55:29.658ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-11-14T08:55:29.658ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-11-14T08:55:29.658ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-11-14T08:55:29.658ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-11-14T08:55:29.658ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-11-14T08:55:29.658ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
812024-11-14T08:55:29.658ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7b47c429-1e53-46e1-a6dc-8833bde95c8b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c1654e8-5949-490c-b293-edf8cb5a6332 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
822024-11-14T08:55:29.658ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
832024-11-14T08:55:29.658ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
842024-11-14T08:55:29.658ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852024-11-14T08:55:29.658ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-11-14T08:55:29.658ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
872024-11-14T08:55:29.658ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-11-14T08:55:29.658ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7b47c429-1e53-46e1-a6dc-8833bde95c8b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c1654e8-5949-490c-b293-edf8cb5a6332 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892024-11-14T08:55:29.658ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902024-11-14T08:55:29.658ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912024-11-14T08:55:29.658ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-11-14T08:55:29.658ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7b47c429-1e53-46e1-a6dc-8833bde95c8b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c1654e8-5949-490c-b293-edf8cb5a6332 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
932024-11-14T08:55:29.658ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
942024-11-14T08:55:29.658ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
952024-11-14T08:55:29.658ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
962024-11-14T08:55:29.658ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
972024-11-14T08:55:29.658ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-11-14T08:55:29.658ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-11-14T08:55:29.658ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7b47c429-1e53-46e1-a6dc-8833bde95c8b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c1654e8-5949-490c-b293-edf8cb5a6332 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-11-14T08:55:29.658ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-11-14T08:55:29.658ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-11-14T08:55:29.658ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1032024-11-14T08:55:29.658ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-11-14T08:55:29.658ZINFOSledAgent (bootstore): No ledger in /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-11-14T08:55:29.658ZINFOSledAgent (bootstore): No ledger in /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-11-14T08:55:29.658ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-11-14T08:55:29.659ZINFOSledAgent (bootstore): No ledger in /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-11-14T08:55:29.659ZINFOSledAgent (bootstore): No ledger in /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-11-14T08:55:29.659ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-11-14T08:55:29.659ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-14T08:55:29.659ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-14T08:55:29.670ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1132024-11-14T08:55:29.670ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1537, tv_nsec: 529296260 } time_to_next_cleanup = 599.999935359s
1142024-11-14T08:55:29.670ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1152024-11-14T08:55:29.670ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-11-14T08:55:29.670ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-11-14T08:55:29.673ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-11-14T08:55:29.673ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-11-14T08:55:29.675ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-11-14T08:55:29.676ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1200
1212024-11-14T08:55:29.676ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-14T08:55:29.676ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-11-14T08:55:29.676ZINFOSledAgent (RSS): No ledger in /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-11-14T08:55:29.676ZINFOSledAgent (RSS): No ledger in /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-11-14T08:55:29.676ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1263
1262024-11-14T08:55:29.676ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1272024-11-14T08:55:29.676ZINFOSledAgent (RSS): No ledger in /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-11-14T08:55:29.676ZINFOSledAgent (RSS): No ledger in /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-11-14T08:55:29.676ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1305
1302024-11-14T08:55:29.676ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-14T08:55:29.676ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-14T08:55:29.676ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1332024-11-14T08:55:29.676ZINFOSledAgent (RSS): Writing ledger to /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-11-14T08:55:29.676ZINFOSledAgent (RSS): Writing ledger to /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-11-14T08:55:29.676ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, sleds: { [fdb0:18c0:4d0d:9fb2::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 65d2236a-3110-4d84-aa25-77e21779db87 (sled), rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-11-14T08:55:29.676ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1339
1372024-11-14T08:55:29.676ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1382024-11-14T08:55:29.676ZINFOSledAgent (bootstore): Writing ledger to /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1392024-11-14T08:55:29.677ZINFOSledAgent (bootstore): Writing ledger to /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1402024-11-14T08:55:29.677ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1412024-11-14T08:55:29.677ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 65d2236a-3110-4d84-aa25-77e21779db87 (sled), rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1422024-11-14T08:55:29.677ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1432024-11-14T08:55:29.677ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1442024-11-14T08:55:29.682ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1452024-11-14T08:55:29.688ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-11-14T08:55:29.688ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-11-14T08:55:29.692ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1482024-11-14T08:55:29.692ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1492024-11-14T08:55:29.692ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:64228
1502024-11-14T08:55:29.692ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 65d2236a-3110-4d84-aa25-77e21779db87 (sled), rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1512024-11-14T08:55:29.692ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1522024-11-14T08:55:29.692ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532024-11-14T08:55:29.692ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542024-11-14T08:55:29.692ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1552024-11-14T08:55:29.692ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1562024-11-14T08:55:29.692ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1572024-11-14T08:55:29.692ZINFOSledAgent (StorageManager): No ledger in /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1582024-11-14T08:55:29.692ZINFOSledAgent (StorageManager): No ledger in /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1592024-11-14T08:55:29.692ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1602024-11-14T08:55:29.692ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1612024-11-14T08:55:29.692ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1622024-11-14T08:55:29.692ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1632024-11-14T08:55:29.692ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1642024-11-14T08:55:29.708ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1652024-11-14T08:55:29.728ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1662024-11-14T08:55:29.745ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1672024-11-14T08:55:29.752ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:408 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
1682024-11-14T08:55:29.752ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1692024-11-14T08:55:29.752ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:420 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
1702024-11-14T08:55:29.752ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1712024-11-14T08:55:29.756ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 106.004998ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e744eb0b-b57c-4cf7-acf1-7fa8cdd8e935", "content-length": "124", "date": "Thu, 14 Nov 2024 08:55:29 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e744eb0b-b57c-4cf7-acf1-7fa8cdd8e935" } file = clients/ddm-admin-client/src/lib.rs:177
1722024-11-14T08:55:29.766ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_7b47c429-1e53-46e1-a6dc-8833bde95c8b/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1732024-11-14T08:55:29.795ZINFOSledAgent: successfully created encrypted zvol: name="oxi_7b47c429-1e53-46e1-a6dc-8833bde95c8b/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1742024-11-14T08:55:29.795ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_7b47c429-1e53-46e1-a6dc-8833bde95c8b/swap" file = sled-agent/src/swap_device.rs:96
1752024-11-14T08:55:29.800ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:435 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
1762024-11-14T08:55:29.800ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1772024-11-14T08:55:29.800ZINFOSledAgent (BackingFs): Ensuring dataset oxi_7b47c429-1e53-46e1-a6dc-8833bde95c8b/backing/fmd file = sled-agent/src/backing_fs.rs:138
1782024-11-14T08:55:29.863ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1792024-11-14T08:55:29.863ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 142.286734ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "dbbb5aba-2a2b-48c1-af9c-dfb6fc51de8c", "content-length": "124", "date": "Thu, 14 Nov 2024 08:55:29 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "dbbb5aba-2a2b-48c1-af9c-dfb6fc51de8c" } file = clients/ddm-admin-client/src/lib.rs:177
1802024-11-14T08:55:29.894ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1812024-11-14T08:55:30.006ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-11-14T08:55:30.007ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 163.151951ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3f788d32-9cbd-4c5b-9d3a-598da4ec5151", "content-length": "124", "date": "Thu, 14 Nov 2024 08:55:29 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3f788d32-9cbd-4c5b-9d3a-598da4ec5151" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-11-14T08:55:30.113ZINFOSledAgent (BackingFs): Mounting oxi_7b47c429-1e53-46e1-a6dc-8833bde95c8b/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1842024-11-14T08:55:30.125ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1852024-11-14T08:55:30.125ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1862024-11-14T08:55:30.125ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1872024-11-14T08:55:30.126ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1882024-11-14T08:55:30.171ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-11-14T08:55:30.171ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 232.513444ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ebdadfb5-7f87-4a32-bf1d-0f730257fc8d", "content-length": "124", "date": "Thu, 14 Nov 2024 08:55:29 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ebdadfb5-7f87-4a32-bf1d-0f730257fc8d" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-11-14T08:55:30.406ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-11-14T08:55:30.406ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 170.145263ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "59eec4aa-f5ff-47bd-93e2-24327db964d7", "content-length": "124", "date": "Thu, 14 Nov 2024 08:55:29 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "59eec4aa-f5ff-47bd-93e2-24327db964d7" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-11-14T08:55:30.578ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-11-14T08:55:30.578ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 315.355772ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3c576779-9237-473f-9a65-7684ae5f6dc3", "content-length": "124", "date": "Thu, 14 Nov 2024 08:55:29 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3c576779-9237-473f-9a65-7684ae5f6dc3" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-11-14T08:55:30.860ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
1952024-11-14T08:55:30.865ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:48029 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
1962024-11-14T08:55:30.866ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
1972024-11-14T08:55:30.866ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:48029 file = oximeter/producer/src/lib.rs:283 interval = 30s producer_id = 65d2236a-3110-4d84-aa25-77e21779db87 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
1982024-11-14T08:55:30.867ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 237.048693ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
1992024-11-14T08:55:30.868ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
2002024-11-14T08:55:30.868ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
2012024-11-14T08:55:30.868ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2022024-11-14T08:55:30.868ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032024-11-14T08:55:30.895ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2042024-11-14T08:55:31.106ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 716.803843ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
2052024-11-14T08:55:31.825ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.360812645s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
2062024-11-14T08:55:33.187ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.735325889s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
2072024-11-14T08:55:33.500ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2082024-11-14T08:55:33.500ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2092024-11-14T08:55:33.500ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2102024-11-14T08:55:33.500ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2112024-11-14T08:55:33.500ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2122024-11-14T08:55:33.500ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2132024-11-14T08:55:33.502ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2142024-11-14T08:55:33.503ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2152024-11-14T08:55:33.503ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='0a0adcc5-bcdd-46d2-a222-ace3abfe409c'/> <propval type="astring" name="rack_id" value='f4ca1ebb-1dae-4dba-966b-c23460ac15fd'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fece:fe31'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='f4ca1ebb-1dae-4dba-966b-c23460ac15fd'/> <propval type="astring" name="sled_id" value='65d2236a-3110-4d84-aa25-77e21779db87'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='65d2236a-3110-4d84-aa25-77e21779db87'/> <propval type="astring" name="rack_uuid" value='f4ca1ebb-1dae-4dba-966b-c23460ac15fd'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='65d2236a-3110-4d84-aa25-77e21779db87'/> <propval type="astring" name="rack_uuid" value='f4ca1ebb-1dae-4dba-966b-c23460ac15fd'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162024-11-14T08:55:33.503ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172024-11-14T08:55:33.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 46.250317ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-11-14T08:55:33.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 100.734001ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-11-14T08:55:34.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 291.49525ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-11-14T08:55:34.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 253.917864ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-11-14T08:55:34.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 487.912064ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-11-14T08:55:35.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.497607246s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-11-14T08:55:35.924ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.165851495s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
2242024-11-14T08:55:37.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.10595544s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-11-14T08:55:38.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 665.918501ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-14T08:55:38.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 899.264329ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-11-14T08:55:40.290ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/65d2236a-3110-4d84-aa25-77e21779db87) file = sled-agent/src/nexus.rs:527 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
2282024-11-14T08:55:40.320ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2292024-11-14T08:55:40.320ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
2302024-11-14T08:55:40.321ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2312024-11-14T08:55:40.321ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2322024-11-14T08:55:40.321ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2332024-11-14T08:55:40.321ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342024-11-14T08:55:40.322ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352024-11-14T08:55:40.322ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2362024-11-14T08:55:40.322ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2372024-11-14T08:55:40.322ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2382024-11-14T08:55:40.322ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:64228
2392024-11-14T08:55:40.521ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2402024-11-14T08:55:40.521ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2412024-11-14T08:55:40.521ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2422024-11-14T08:55:40.521ZINFOSledAgent (RSS): No ledger in /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2432024-11-14T08:55:40.521ZINFOSledAgent (RSS): No ledger in /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2442024-11-14T08:55:40.521ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2452024-11-14T08:55:40.521ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2462024-11-14T08:55:40.521ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2472024-11-14T08:55:40.521ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2482024-11-14T08:55:40.525ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2492024-11-14T08:55:40.525ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2502024-11-14T08:55:40.525ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2512024-11-14T08:55:40.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38186
2522024-11-14T08:55:40.792ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2532024-11-14T08:55:40.792ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2542024-11-14T08:55:40.792ZINFOSledAgent (ServiceManager): No ledger in /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/omicron-zones.json file = common/src/ledger.rs:188
2552024-11-14T08:55:40.792ZINFOSledAgent (ServiceManager): No ledger in /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/omicron-zones.json file = common/src/ledger.rs:188
2562024-11-14T08:55:40.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38186 req_id = 1c7b74a8-154a-4621-a662-db3cf23452ba response_code = 200 uri = /inventory
2572024-11-14T08:55:40.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42271
2582024-11-14T08:55:40.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42271 req_id = e0289672-f7d2-4a4b-b927-d85b888d0c68 response_code = 200 uri = /sled-role
2592024-11-14T08:55:40.827ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2602024-11-14T08:55:40.827ZINFOSledAgent (RSS): Writing ledger to /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2612024-11-14T08:55:40.827ZINFOSledAgent (RSS): Writing ledger to /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2622024-11-14T08:55:40.828ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:980
2632024-11-14T08:55:40.859ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: cd415549-0258-449f-aa19-cf7171e2587e, pool_id: 371f3005-927c-4e65-88a0-18072469758d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 950d2de6-2637-4436-a0d3-9ba523727d49, pool_id: adf8829f-c3eb-4450-b693-c7220506810c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 7fabb104-1856-4a1b-8da2-3923d61d57a7, pool_id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 60be75f9-28b1-40b9-986e-56ae96031735, pool_id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 580dcdbe-e541-45de-93ac-7679c9c5802d, pool_id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: b8dff153-5c68-43c0-890d-53d245d702d9, pool_id: 6032d020-e97f-4442-878e-bcdbe3293876 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 2ab39428-a42f-4c14-9aba-0fbf5b8fcdce, pool_id: 8a4b1a2c-0585-4f12-8c9a-b7cf61af774a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: b25e4d6a-34fb-4d51-ae43-9663b6aa7828, pool_id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: ea7d7654-b099-4e9f-a1d1-140b8ef9a6d8, pool_id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:382 sled_address = [fd00:1122:3344:101::1]:12345
2642024-11-14T08:55:40.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48419
2652024-11-14T08:55:40.859ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:884 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
2662024-11-14T08:55:40.859ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: cd415549-0258-449f-aa19-cf7171e2587e, pool_id: 371f3005-927c-4e65-88a0-18072469758d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 950d2de6-2637-4436-a0d3-9ba523727d49, pool_id: adf8829f-c3eb-4450-b693-c7220506810c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 7fabb104-1856-4a1b-8da2-3923d61d57a7, pool_id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 60be75f9-28b1-40b9-986e-56ae96031735, pool_id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 580dcdbe-e541-45de-93ac-7679c9c5802d, pool_id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: b8dff153-5c68-43c0-890d-53d245d702d9, pool_id: 6032d020-e97f-4442-878e-bcdbe3293876 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 2ab39428-a42f-4c14-9aba-0fbf5b8fcdce, pool_id: 8a4b1a2c-0585-4f12-8c9a-b7cf61af774a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: b25e4d6a-34fb-4d51-ae43-9663b6aa7828, pool_id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: ea7d7654-b099-4e9f-a1d1-140b8ef9a6d8, pool_id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2672024-11-14T08:55:40.859ZINFOSledAgent (StorageManager): No ledger in /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2682024-11-14T08:55:40.859ZINFOSledAgent (StorageManager): No ledger in /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2692024-11-14T08:55:40.859ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2702024-11-14T08:55:40.859ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2712024-11-14T08:55:40.859ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2722024-11-14T08:55:40.859ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2732024-11-14T08:55:40.859ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2742024-11-14T08:55:41.005ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14851105500590910663 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
2752024-11-14T08:55:41.005ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8864389262755666366 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
2762024-11-14T08:55:41.012ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2772024-11-14T08:55:41.012ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 371f3005-927c-4e65-88a0-18072469758d (zpool)
2782024-11-14T08:55:41.234ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
2792024-11-14T08:55:41.239ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.407412767s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
2802024-11-14T08:55:41.323ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/65d2236a-3110-4d84-aa25-77e21779db87) file = sled-agent/src/probe_manager.rs:231 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
2812024-11-14T08:55:41.351ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }
2822024-11-14T08:55:41.359ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2832024-11-14T08:55:41.359ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2842024-11-14T08:55:41.359ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2852024-11-14T08:55:41.359ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2862024-11-14T08:55:41.359ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2872024-11-14T08:55:41.359ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2882024-11-14T08:55:41.359ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2892024-11-14T08:55:41.401ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2902024-11-14T08:55:41.409ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_371f3005-927c-4e65-88a0-18072469758d/crypt/zone file = sled-storage/src/dataset.rs:303
2912024-11-14T08:55:41.612ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_371f3005-927c-4e65-88a0-18072469758d file = sled-storage/src/dataset.rs:389
2922024-11-14T08:55:41.620ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2932024-11-14T08:55:41.620ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2942024-11-14T08:55:41.620ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2952024-11-14T08:55:41.620ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2962024-11-14T08:55:41.620ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2972024-11-14T08:55:41.629ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2982024-11-14T08:55:41.629ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = adf8829f-c3eb-4450-b693-c7220506810c (zpool)
2992024-11-14T08:55:41.741ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }
3002024-11-14T08:55:41.748ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
3012024-11-14T08:55:41.748ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
3022024-11-14T08:55:41.748ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
3032024-11-14T08:55:41.748ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
3042024-11-14T08:55:41.748ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3052024-11-14T08:55:41.748ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3062024-11-14T08:55:41.748ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3072024-11-14T08:55:41.790ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3082024-11-14T08:55:41.798ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_adf8829f-c3eb-4450-b693-c7220506810c/crypt/zone file = sled-storage/src/dataset.rs:303
3092024-11-14T08:55:42.003ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_adf8829f-c3eb-4450-b693-c7220506810c file = sled-storage/src/dataset.rs:389
3102024-11-14T08:55:42.011ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3112024-11-14T08:55:42.011ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3122024-11-14T08:55:42.011ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3132024-11-14T08:55:42.011ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3142024-11-14T08:55:42.012ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3152024-11-14T08:55:42.020ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3162024-11-14T08:55:42.020ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool)
3172024-11-14T08:55:42.129ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }
3182024-11-14T08:55:42.137ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3192024-11-14T08:55:42.137ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3202024-11-14T08:55:42.137ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3212024-11-14T08:55:42.137ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3222024-11-14T08:55:42.137ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3232024-11-14T08:55:42.137ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3242024-11-14T08:55:42.137ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3252024-11-14T08:55:42.180ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3262024-11-14T08:55:42.187ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7d1e429d-74f9-4a0f-9382-4b993f07db56/crypt/zone file = sled-storage/src/dataset.rs:303
3272024-11-14T08:55:42.325ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/65d2236a-3110-4d84-aa25-77e21779db87) file = sled-agent/src/probe_manager.rs:231 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
3282024-11-14T08:55:42.388ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7d1e429d-74f9-4a0f-9382-4b993f07db56 file = sled-storage/src/dataset.rs:389
3292024-11-14T08:55:42.396ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3302024-11-14T08:55:42.396ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3312024-11-14T08:55:42.396ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3322024-11-14T08:55:42.396ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3332024-11-14T08:55:42.396ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3342024-11-14T08:55:42.406ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3352024-11-14T08:55:42.407ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 493c27e1-df39-477b-8315-ad9aa5767668 (zpool)
3362024-11-14T08:55:42.524ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }
3372024-11-14T08:55:42.532ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3382024-11-14T08:55:42.532ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3392024-11-14T08:55:42.532ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3402024-11-14T08:55:42.532ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3412024-11-14T08:55:42.532ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3422024-11-14T08:55:42.532ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3432024-11-14T08:55:42.532ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3442024-11-14T08:55:42.573ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3452024-11-14T08:55:42.580ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_493c27e1-df39-477b-8315-ad9aa5767668/crypt/zone file = sled-storage/src/dataset.rs:303
3462024-11-14T08:55:42.784ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_493c27e1-df39-477b-8315-ad9aa5767668 file = sled-storage/src/dataset.rs:389
3472024-11-14T08:55:42.791ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3482024-11-14T08:55:42.791ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3492024-11-14T08:55:42.791ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3502024-11-14T08:55:42.791ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3512024-11-14T08:55:42.791ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3522024-11-14T08:55:42.801ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3532024-11-14T08:55:42.801ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ef6848de-2e18-4d49-825f-a08523c761f3 (zpool)
3542024-11-14T08:55:42.916ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }
3552024-11-14T08:55:42.923ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3562024-11-14T08:55:42.923ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3572024-11-14T08:55:42.923ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3582024-11-14T08:55:42.923ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3592024-11-14T08:55:42.923ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3602024-11-14T08:55:42.923ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3612024-11-14T08:55:42.923ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3622024-11-14T08:55:42.963ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3632024-11-14T08:55:42.971ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ef6848de-2e18-4d49-825f-a08523c761f3/crypt/zone file = sled-storage/src/dataset.rs:303
3642024-11-14T08:55:43.174ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ef6848de-2e18-4d49-825f-a08523c761f3 file = sled-storage/src/dataset.rs:389
3652024-11-14T08:55:43.182ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3662024-11-14T08:55:43.182ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3672024-11-14T08:55:43.182ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3682024-11-14T08:55:43.182ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3692024-11-14T08:55:43.182ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3702024-11-14T08:55:43.192ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3712024-11-14T08:55:43.192ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 6032d020-e97f-4442-878e-bcdbe3293876 (zpool)
3722024-11-14T08:55:43.303ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 6032d020-e97f-4442-878e-bcdbe3293876 (zpool), kind: External }
3732024-11-14T08:55:43.311ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3742024-11-14T08:55:43.311ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3752024-11-14T08:55:43.311ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3762024-11-14T08:55:43.311ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3772024-11-14T08:55:43.311ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3782024-11-14T08:55:43.311ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3792024-11-14T08:55:43.311ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3802024-11-14T08:55:43.327ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/65d2236a-3110-4d84-aa25-77e21779db87) file = sled-agent/src/probe_manager.rs:231 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
3812024-11-14T08:55:43.368ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3822024-11-14T08:55:43.376ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6032d020-e97f-4442-878e-bcdbe3293876/crypt/zone file = sled-storage/src/dataset.rs:303
3832024-11-14T08:55:43.574ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6032d020-e97f-4442-878e-bcdbe3293876 file = sled-storage/src/dataset.rs:389
3842024-11-14T08:55:43.582ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3852024-11-14T08:55:43.582ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3862024-11-14T08:55:43.582ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3872024-11-14T08:55:43.582ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3882024-11-14T08:55:43.582ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3892024-11-14T08:55:43.592ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3902024-11-14T08:55:43.592ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 8a4b1a2c-0585-4f12-8c9a-b7cf61af774a (zpool)
3912024-11-14T08:55:43.711ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8a4b1a2c-0585-4f12-8c9a-b7cf61af774a (zpool), kind: External }
3922024-11-14T08:55:43.718ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3932024-11-14T08:55:43.718ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3942024-11-14T08:55:43.718ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3952024-11-14T08:55:43.718ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3962024-11-14T08:55:43.718ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3972024-11-14T08:55:43.719ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3982024-11-14T08:55:43.719ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3992024-11-14T08:55:43.759ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4002024-11-14T08:55:43.766ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8a4b1a2c-0585-4f12-8c9a-b7cf61af774a/crypt/zone file = sled-storage/src/dataset.rs:303
4012024-11-14T08:55:43.973ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8a4b1a2c-0585-4f12-8c9a-b7cf61af774a file = sled-storage/src/dataset.rs:389
4022024-11-14T08:55:43.981ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4032024-11-14T08:55:43.981ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4042024-11-14T08:55:43.981ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4052024-11-14T08:55:43.981ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4062024-11-14T08:55:43.981ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4072024-11-14T08:55:43.991ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4082024-11-14T08:55:43.991ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d752d0db-efe8-492a-8a25-a56ee29e644b (zpool)
4092024-11-14T08:55:44.112ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }
4102024-11-14T08:55:44.120ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4112024-11-14T08:55:44.120ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4122024-11-14T08:55:44.120ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4132024-11-14T08:55:44.120ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4142024-11-14T08:55:44.120ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4152024-11-14T08:55:44.120ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4162024-11-14T08:55:44.120ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4172024-11-14T08:55:44.164ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4182024-11-14T08:55:44.172ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d752d0db-efe8-492a-8a25-a56ee29e644b/crypt/zone file = sled-storage/src/dataset.rs:303
4192024-11-14T08:55:44.331ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/65d2236a-3110-4d84-aa25-77e21779db87) file = sled-agent/src/probe_manager.rs:231 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
4202024-11-14T08:55:44.378ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d752d0db-efe8-492a-8a25-a56ee29e644b file = sled-storage/src/dataset.rs:389
4212024-11-14T08:55:44.386ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4222024-11-14T08:55:44.386ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4232024-11-14T08:55:44.386ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4242024-11-14T08:55:44.386ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4252024-11-14T08:55:44.386ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4262024-11-14T08:55:44.395ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4272024-11-14T08:55:44.395ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool)
4282024-11-14T08:55:44.507ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External }
4292024-11-14T08:55:44.515ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4302024-11-14T08:55:44.515ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4312024-11-14T08:55:44.515ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4322024-11-14T08:55:44.515ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4332024-11-14T08:55:44.516ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4342024-11-14T08:55:44.516ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4352024-11-14T08:55:44.516ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4362024-11-14T08:55:44.556ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4372024-11-14T08:55:44.564ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7/crypt/zone file = sled-storage/src/dataset.rs:303
4382024-11-14T08:55:44.771ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 file = sled-storage/src/dataset.rs:389
4392024-11-14T08:55:44.779ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4402024-11-14T08:55:44.779ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4412024-11-14T08:55:44.779ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4422024-11-14T08:55:44.779ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7b47c429-1e53-46e1-a6dc-8833bde95c8b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c1654e8-5949-490c-b293-edf8cb5a6332 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6032d020-e97f-4442-878e-bcdbe3293876 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8a4b1a2c-0585-4f12-8c9a-b7cf61af774a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4432024-11-14T08:55:44.779ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4442024-11-14T08:55:44.779ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4452024-11-14T08:55:44.780ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4462024-11-14T08:55:44.780ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:888 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
4472024-11-14T08:55:44.780ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4482024-11-14T08:55:44.780ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:914 generation = Generation(1) sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
4492024-11-14T08:55:44.780ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:919 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
4502024-11-14T08:55:44.780ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:924 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
4512024-11-14T08:55:44.780ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
4522024-11-14T08:55:44.780ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:930 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
4532024-11-14T08:55:44.780ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4542024-11-14T08:55:44.780ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:935 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
4552024-11-14T08:55:44.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3920945 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48419 req_id = c7afa31f-0444-4e4e-a31b-cf2830e7fb2a response_code = 200 uri = /omicron-physical-disks
4562024-11-14T08:55:44.811ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {00596010-3efa-43ee-b9b2-50cf3c6055ca (dataset): DatasetConfig { id: 00596010-3efa-43ee-b9b2-50cf3c6055ca (dataset), name: DatasetName { pool_name: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 06c46715-d531-4e35-aa12-44ba5c8ed7a3 (dataset): DatasetConfig { id: 06c46715-d531-4e35-aa12-44ba5c8ed7a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b869137-729b-4197-aa03-dda3d7bcd430 (dataset): DatasetConfig { id: 0b869137-729b-4197-aa03-dda3d7bcd430 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6032d020-e97f-4442-878e-bcdbe3293876 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0e96ba3f-9ad0-4954-bbcf-3850919fcb81 (dataset): DatasetConfig { id: 0e96ba3f-9ad0-4954-bbcf-3850919fcb81 (dataset), name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e96c60a-8b56-4bf4-bafc-00b27af10367 (dataset): DatasetConfig { id: 0e96c60a-8b56-4bf4-bafc-00b27af10367 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f4dc0e5-829a-41ed-9640-479b9fac99fb (dataset): DatasetConfig { id: 0f4dc0e5-829a-41ed-9640-479b9fac99fb (dataset), name: DatasetName { pool_name: ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10dec706-8c11-4e92-9546-f425017ddca2 (dataset): DatasetConfig { id: 10dec706-8c11-4e92-9546-f425017ddca2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12ac4d4a-df37-46c3-8869-2d96147b7b92 (dataset): DatasetConfig { id: 12ac4d4a-df37-46c3-8869-2d96147b7b92 (dataset), name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14179b8c-7c00-4ffb-bf99-b8e3fa62fb3c (dataset): DatasetConfig { id: 14179b8c-7c00-4ffb-bf99-b8e3fa62fb3c (dataset), name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1704344f-f7d4-4287-8965-bf3c258300d4 (dataset): DatasetConfig { id: 1704344f-f7d4-4287-8965-bf3c258300d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 19c004d2-8336-4583-867d-bae284df4cc1 (dataset): DatasetConfig { id: 19c004d2-8336-4583-867d-bae284df4cc1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b58438e-5452-421c-8324-72bbe95b8690 (dataset): DatasetConfig { id: 1b58438e-5452-421c-8324-72bbe95b8690 (dataset), name: DatasetName { pool_name: ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1c1916a3-0fc4-42b7-be90-cc734590492b (dataset): DatasetConfig { id: 1c1916a3-0fc4-42b7-be90-cc734590492b (dataset), name: DatasetName { pool_name: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1f36695f-e004-41f8-add0-5f657617afdb (dataset): DatasetConfig { id: 1f36695f-e004-41f8-add0-5f657617afdb (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 203307dd-7722-4b55-af11-cf6378047025 (dataset): DatasetConfig { id: 203307dd-7722-4b55-af11-cf6378047025 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2188ccc3-fdab-4c05-947c-fce8e696cc8c (dataset): DatasetConfig { id: 2188ccc3-fdab-4c05-947c-fce8e696cc8c (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 268b813d-5eae-4d88-b02a-d517d572f31e (dataset): DatasetConfig { id: 268b813d-5eae-4d88-b02a-d517d572f31e (dataset), name: DatasetName { pool_name: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29b4bbf5-ac54-494a-b720-3b54071e515c (dataset): DatasetConfig { id: 29b4bbf5-ac54-494a-b720-3b54071e515c (dataset), name: DatasetName { pool_name: ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2ae621a9-e7c7-4006-9731-f8ad890649ff (dataset): DatasetConfig { id: 2ae621a9-e7c7-4006-9731-f8ad890649ff (dataset), name: DatasetName { pool_name: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2bb4925f-6aa3-4a79-bbbb-21fa376e79ab (dataset): DatasetConfig { id: 2bb4925f-6aa3-4a79-bbbb-21fa376e79ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2e55232c-e529-484c-a607-7ddf7742c33e (dataset): DatasetConfig { id: 2e55232c-e529-484c-a607-7ddf7742c33e (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 310e6da6-f1d7-4e25-9d09-1c0dce4fb3c2 (dataset): DatasetConfig { id: 310e6da6-f1d7-4e25-9d09-1c0dce4fb3c2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6032d020-e97f-4442-878e-bcdbe3293876 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 31f01657-8938-4f5b-901f-0f086cc773de (dataset): DatasetConfig { id: 31f01657-8938-4f5b-901f-0f086cc773de (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33a4682e-626a-414f-a37c-fd40c8a05974 (dataset): DatasetConfig { id: 33a4682e-626a-414f-a37c-fd40c8a05974 (dataset), name: DatasetName { pool_name: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 34199a93-eeca-442a-82a6-afe9b9803c89 (dataset): DatasetConfig { id: 34199a93-eeca-442a-82a6-afe9b9803c89 (dataset), name: DatasetName { pool_name: ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e5b2203-72de-46b3-8232-1a931e0bd63d (dataset): DatasetConfig { id: 3e5b2203-72de-46b3-8232-1a931e0bd63d (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3f5a947a-b2e3-4d5c-b569-e67f80c15b10 (dataset): DatasetConfig { id: 3f5a947a-b2e3-4d5c-b569-e67f80c15b10 (dataset), name: DatasetName { pool_name: ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 41581498-efd5-4100-bb42-7a2489c16d8d (dataset): DatasetConfig { id: 41581498-efd5-4100-bb42-7a2489c16d8d (dataset), name: DatasetName { pool_name: ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 427eea77-edcb-426e-980b-01d8a6129959 (dataset): DatasetConfig { id: 427eea77-edcb-426e-980b-01d8a6129959 (dataset), name: DatasetName { pool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 43d95e65-363a-4607-a9d4-4058cc35791b (dataset): DatasetConfig { id: 43d95e65-363a-4607-a9d4-4058cc35791b (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47c1534b-cd09-4afa-bc58-2e9c7727b094 (dataset): DatasetConfig { id: 47c1534b-cd09-4afa-bc58-2e9c7727b094 (dataset), name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4872b181-34d9-4461-8585-6af69a93eefd (dataset): DatasetConfig { id: 4872b181-34d9-4461-8585-6af69a93eefd (dataset), name: DatasetName { pool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4fa77803-8ac3-4b06-8ee9-36c4b70b8e6a (dataset): DatasetConfig { id: 4fa77803-8ac3-4b06-8ee9-36c4b70b8e6a (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56bc5c58-ab5e-4b2d-93ef-2e411d65b18a (dataset): DatasetConfig { id: 56bc5c58-ab5e-4b2d-93ef-2e411d65b18a (dataset), name: DatasetName { pool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56d7e047-4e21-4006-80c4-c2a2410ab994 (dataset): DatasetConfig { id: 56d7e047-4e21-4006-80c4-c2a2410ab994 (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 629ce320-217e-469b-adc0-eab109668651 (dataset): DatasetConfig { id: 629ce320-217e-469b-adc0-eab109668651 (dataset), name: DatasetName { pool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f949dbc-4a06-4e70-8ea9-64cbe2f1a84b (dataset): DatasetConfig { id: 6f949dbc-4a06-4e70-8ea9-64cbe2f1a84b (dataset), name: DatasetName { pool_name: ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 717acd01-d3b6-4572-a0b5-c7bafcc4974d (dataset): DatasetConfig { id: 717acd01-d3b6-4572-a0b5-c7bafcc4974d (dataset), name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 764d14f7-3dd3-46ac-8c5d-5e713508c3b6 (dataset): DatasetConfig { id: 764d14f7-3dd3-46ac-8c5d-5e713508c3b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 771eb731-41b5-4ee4-8745-4e18fdf23a1a (dataset): DatasetConfig { id: 771eb731-41b5-4ee4-8745-4e18fdf23a1a (dataset), name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 79eb61f2-1663-4ca8-a723-892385f36470 (dataset): DatasetConfig { id: 79eb61f2-1663-4ca8-a723-892385f36470 (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7bc9d685-ccc3-4a4c-8100-34ecdb4ff0da (dataset): DatasetConfig { id: 7bc9d685-ccc3-4a4c-8100-34ecdb4ff0da (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e885090-6b95-4541-ab0d-85d9ae4d8117 (dataset): DatasetConfig { id: 7e885090-6b95-4541-ab0d-85d9ae4d8117 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a4b1a2c-0585-4f12-8c9a-b7cf61af774a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95120318-27eb-411d-9b20-9d42b87307d0 (dataset): DatasetConfig { id: 95120318-27eb-411d-9b20-9d42b87307d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9570ca41-e77b-4bc3-866e-98f7d06e556c (dataset): DatasetConfig { id: 9570ca41-e77b-4bc3-866e-98f7d06e556c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9880bb9f-4b77-43a7-8d71-71e2746589d6 (dataset): DatasetConfig { id: 9880bb9f-4b77-43a7-8d71-71e2746589d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a09d6e18-5924-4698-9787-7796ff672ccd (dataset): DatasetConfig { id: a09d6e18-5924-4698-9787-7796ff672ccd (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1a37b57-b0e3-4ad9-ab9f-5ad69ce1cedd (dataset): DatasetConfig { id: a1a37b57-b0e3-4ad9-ab9f-5ad69ce1cedd (dataset), name: DatasetName { pool_name: ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a2f40235-30b8-4681-a639-09326a473d34 (dataset): DatasetConfig { id: a2f40235-30b8-4681-a639-09326a473d34 (dataset), name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a92e0bc5-5591-493b-b881-2f1b6d5ea676 (dataset): DatasetConfig { id: a92e0bc5-5591-493b-b881-2f1b6d5ea676 (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5fc58b0-2401-4b7e-b353-463a2b0cce03 (dataset): DatasetConfig { id: b5fc58b0-2401-4b7e-b353-463a2b0cce03 (dataset), name: DatasetName { pool_name: ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, baf9141f-641a-49c1-b6ff-f20e74ec60bc (dataset): DatasetConfig { id: baf9141f-641a-49c1-b6ff-f20e74ec60bc (dataset), name: DatasetName { pool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbc39a08-9ac5-42bf-8fe1-72bda5d26fb2 (dataset): DatasetConfig { id: bbc39a08-9ac5-42bf-8fe1-72bda5d26fb2 (dataset), name: DatasetName { pool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, be9e5052-4d67-4762-b71b-e0464a86bf95 (dataset): DatasetConfig { id: be9e5052-4d67-4762-b71b-e0464a86bf95 (dataset), name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c3a20c30-6637-4903-8237-13ed27a33851 (dataset): DatasetConfig { id: c3a20c30-6637-4903-8237-13ed27a33851 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a4b1a2c-0585-4f12-8c9a-b7cf61af774a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c7d5cd8a-6663-4683-8d7e-a4d892e3bddd (dataset): DatasetConfig { id: c7d5cd8a-6663-4683-8d7e-a4d892e3bddd (dataset), name: DatasetName { pool_name: ZpoolName { id: 6032d020-e97f-4442-878e-bcdbe3293876 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db169364-d0ab-4f02-8dd5-b5d0828e9f9c (dataset): DatasetConfig { id: db169364-d0ab-4f02-8dd5-b5d0828e9f9c (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a4b1a2c-0585-4f12-8c9a-b7cf61af774a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e073ef40-938f-4b52-a6c9-fbe023a948fa (dataset): DatasetConfig { id: e073ef40-938f-4b52-a6c9-fbe023a948fa (dataset), name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e227c393-9861-49c4-a8ea-9c1577e37d20 (dataset): DatasetConfig { id: e227c393-9861-49c4-a8ea-9c1577e37d20 (dataset), name: DatasetName { pool_name: ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e465b551-bb47-4457-b2b6-a3b225c67bf7 (dataset): DatasetConfig { id: e465b551-bb47-4457-b2b6-a3b225c67bf7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6032d020-e97f-4442-878e-bcdbe3293876 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e52fff67-67ab-46fd-9e0a-99df81d68c71 (dataset): DatasetConfig { id: e52fff67-67ab-46fd-9e0a-99df81d68c71 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a4b1a2c-0585-4f12-8c9a-b7cf61af774a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e6ae6112-d2c4-419a-9c00-ffa0b683622e (dataset): DatasetConfig { id: e6ae6112-d2c4-419a-9c00-ffa0b683622e (dataset), name: DatasetName { pool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb14215d-1479-41cc-ac30-66283023ca5f (dataset): DatasetConfig { id: eb14215d-1479-41cc-ac30-66283023ca5f (dataset), name: DatasetName { pool_name: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f58e5b5c-a9a2-4254-8218-c2f1efd71116 (dataset): DatasetConfig { id: f58e5b5c-a9a2-4254-8218-c2f1efd71116 (dataset), name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fc8540d0-025d-463f-a04d-b83129f21832 (dataset): DatasetConfig { id: fc8540d0-025d-463f-a04d-b83129f21832 (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe95b7ad-2a1f-4a85-981e-e091d978d009 (dataset): DatasetConfig { id: fe95b7ad-2a1f-4a85-981e-e091d978d009 (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:457 sled_address = [fd00:1122:3344:101::1]:12345
4572024-11-14T08:55:44.811ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45020
4582024-11-14T08:55:44.812ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:850 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
4592024-11-14T08:55:44.814ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {00596010-3efa-43ee-b9b2-50cf3c6055ca (dataset): DatasetConfig { id: 00596010-3efa-43ee-b9b2-50cf3c6055ca (dataset), name: DatasetName { pool_name: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 06c46715-d531-4e35-aa12-44ba5c8ed7a3 (dataset): DatasetConfig { id: 06c46715-d531-4e35-aa12-44ba5c8ed7a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b869137-729b-4197-aa03-dda3d7bcd430 (dataset): DatasetConfig { id: 0b869137-729b-4197-aa03-dda3d7bcd430 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6032d020-e97f-4442-878e-bcdbe3293876 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0e96ba3f-9ad0-4954-bbcf-3850919fcb81 (dataset): DatasetConfig { id: 0e96ba3f-9ad0-4954-bbcf-3850919fcb81 (dataset), name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e96c60a-8b56-4bf4-bafc-00b27af10367 (dataset): DatasetConfig { id: 0e96c60a-8b56-4bf4-bafc-00b27af10367 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f4dc0e5-829a-41ed-9640-479b9fac99fb (dataset): DatasetConfig { id: 0f4dc0e5-829a-41ed-9640-479b9fac99fb (dataset), name: DatasetName { pool_name: ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10dec706-8c11-4e92-9546-f425017ddca2 (dataset): DatasetConfig { id: 10dec706-8c11-4e92-9546-f425017ddca2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12ac4d4a-df37-46c3-8869-2d96147b7b92 (dataset): DatasetConfig { id: 12ac4d4a-df37-46c3-8869-2d96147b7b92 (dataset), name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14179b8c-7c00-4ffb-bf99-b8e3fa62fb3c (dataset): DatasetConfig { id: 14179b8c-7c00-4ffb-bf99-b8e3fa62fb3c (dataset), name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1704344f-f7d4-4287-8965-bf3c258300d4 (dataset): DatasetConfig { id: 1704344f-f7d4-4287-8965-bf3c258300d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 19c004d2-8336-4583-867d-bae284df4cc1 (dataset): DatasetConfig { id: 19c004d2-8336-4583-867d-bae284df4cc1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b58438e-5452-421c-8324-72bbe95b8690 (dataset): DatasetConfig { id: 1b58438e-5452-421c-8324-72bbe95b8690 (dataset), name: DatasetName { pool_name: ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1c1916a3-0fc4-42b7-be90-cc734590492b (dataset): DatasetConfig { id: 1c1916a3-0fc4-42b7-be90-cc734590492b (dataset), name: DatasetName { pool_name: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1f36695f-e004-41f8-add0-5f657617afdb (dataset): DatasetConfig { id: 1f36695f-e004-41f8-add0-5f657617afdb (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 203307dd-7722-4b55-af11-cf6378047025 (dataset): DatasetConfig { id: 203307dd-7722-4b55-af11-cf6378047025 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2188ccc3-fdab-4c05-947c-fce8e696cc8c (dataset): DatasetConfig { id: 2188ccc3-fdab-4c05-947c-fce8e696cc8c (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 268b813d-5eae-4d88-b02a-d517d572f31e (dataset): DatasetConfig { id: 268b813d-5eae-4d88-b02a-d517d572f31e (dataset), name: DatasetName { pool_name: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29b4bbf5-ac54-494a-b720-3b54071e515c (dataset): DatasetConfig { id: 29b4bbf5-ac54-494a-b720-3b54071e515c (dataset), name: DatasetName { pool_name: ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2ae621a9-e7c7-4006-9731-f8ad890649ff (dataset): DatasetConfig { id: 2ae621a9-e7c7-4006-9731-f8ad890649ff (dataset), name: DatasetName { pool_name: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2bb4925f-6aa3-4a79-bbbb-21fa376e79ab (dataset): DatasetConfig { id: 2bb4925f-6aa3-4a79-bbbb-21fa376e79ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2e55232c-e529-484c-a607-7ddf7742c33e (dataset): DatasetConfig { id: 2e55232c-e529-484c-a607-7ddf7742c33e (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 310e6da6-f1d7-4e25-9d09-1c0dce4fb3c2 (dataset): DatasetConfig { id: 310e6da6-f1d7-4e25-9d09-1c0dce4fb3c2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6032d020-e97f-4442-878e-bcdbe3293876 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 31f01657-8938-4f5b-901f-0f086cc773de (dataset): DatasetConfig { id: 31f01657-8938-4f5b-901f-0f086cc773de (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33a4682e-626a-414f-a37c-fd40c8a05974 (dataset): DatasetConfig { id: 33a4682e-626a-414f-a37c-fd40c8a05974 (dataset), name: DatasetName { pool_name: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 34199a93-eeca-442a-82a6-afe9b9803c89 (dataset): DatasetConfig { id: 34199a93-eeca-442a-82a6-afe9b9803c89 (dataset), name: DatasetName { pool_name: ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e5b2203-72de-46b3-8232-1a931e0bd63d (dataset): DatasetConfig { id: 3e5b2203-72de-46b3-8232-1a931e0bd63d (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3f5a947a-b2e3-4d5c-b569-e67f80c15b10 (dataset): DatasetConfig { id: 3f5a947a-b2e3-4d5c-b569-e67f80c15b10 (dataset), name: DatasetName { pool_name: ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 41581498-efd5-4100-bb42-7a2489c16d8d (dataset): DatasetConfig { id: 41581498-efd5-4100-bb42-7a2489c16d8d (dataset), name: DatasetName { pool_name: ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 427eea77-edcb-426e-980b-01d8a6129959 (dataset): DatasetConfig { id: 427eea77-edcb-426e-980b-01d8a6129959 (dataset), name: DatasetName { pool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 43d95e65-363a-4607-a9d4-4058cc35791b (dataset): DatasetConfig { id: 43d95e65-363a-4607-a9d4-4058cc35791b (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47c1534b-cd09-4afa-bc58-2e9c7727b094 (dataset): DatasetConfig { id: 47c1534b-cd09-4afa-bc58-2e9c7727b094 (dataset), name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4872b181-34d9-4461-8585-6af69a93eefd (dataset): DatasetConfig { id: 4872b181-34d9-4461-8585-6af69a93eefd (dataset), name: DatasetName { pool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4fa77803-8ac3-4b06-8ee9-36c4b70b8e6a (dataset): DatasetConfig { id: 4fa77803-8ac3-4b06-8ee9-36c4b70b8e6a (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56bc5c58-ab5e-4b2d-93ef-2e411d65b18a (dataset): DatasetConfig { id: 56bc5c58-ab5e-4b2d-93ef-2e411d65b18a (dataset), name: DatasetName { pool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56d7e047-4e21-4006-80c4-c2a2410ab994 (dataset): DatasetConfig { id: 56d7e047-4e21-4006-80c4-c2a2410ab994 (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 629ce320-217e-469b-adc0-eab109668651 (dataset): DatasetConfig { id: 629ce320-217e-469b-adc0-eab109668651 (dataset), name: DatasetName { pool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f949dbc-4a06-4e70-8ea9-64cbe2f1a84b (dataset): DatasetConfig { id: 6f949dbc-4a06-4e70-8ea9-64cbe2f1a84b (dataset), name: DatasetName { pool_name: ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 717acd01-d3b6-4572-a0b5-c7bafcc4974d (dataset): DatasetConfig { id: 717acd01-d3b6-4572-a0b5-c7bafcc4974d (dataset), name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 764d14f7-3dd3-46ac-8c5d-5e713508c3b6 (dataset): DatasetConfig { id: 764d14f7-3dd3-46ac-8c5d-5e713508c3b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 771eb731-41b5-4ee4-8745-4e18fdf23a1a (dataset): DatasetConfig { id: 771eb731-41b5-4ee4-8745-4e18fdf23a1a (dataset), name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 79eb61f2-1663-4ca8-a723-892385f36470 (dataset): DatasetConfig { id: 79eb61f2-1663-4ca8-a723-892385f36470 (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7bc9d685-ccc3-4a4c-8100-34ecdb4ff0da (dataset): DatasetConfig { id: 7bc9d685-ccc3-4a4c-8100-34ecdb4ff0da (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e885090-6b95-4541-ab0d-85d9ae4d8117 (dataset): DatasetConfig { id: 7e885090-6b95-4541-ab0d-85d9ae4d8117 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a4b1a2c-0585-4f12-8c9a-b7cf61af774a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95120318-27eb-411d-9b20-9d42b87307d0 (dataset): DatasetConfig { id: 95120318-27eb-411d-9b20-9d42b87307d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9570ca41-e77b-4bc3-866e-98f7d06e556c (dataset): DatasetConfig { id: 9570ca41-e77b-4bc3-866e-98f7d06e556c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9880bb9f-4b77-43a7-8d71-71e2746589d6 (dataset): DatasetConfig { id: 9880bb9f-4b77-43a7-8d71-71e2746589d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a09d6e18-5924-4698-9787-7796ff672ccd (dataset): DatasetConfig { id: a09d6e18-5924-4698-9787-7796ff672ccd (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1a37b57-b0e3-4ad9-ab9f-5ad69ce1cedd (dataset): DatasetConfig { id: a1a37b57-b0e3-4ad9-ab9f-5ad69ce1cedd (dataset), name: DatasetName { pool_name: ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a2f40235-30b8-4681-a639-09326a473d34 (dataset): DatasetConfig { id: a2f40235-30b8-4681-a639-09326a473d34 (dataset), name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a92e0bc5-5591-493b-b881-2f1b6d5ea676 (dataset): DatasetConfig { id: a92e0bc5-5591-493b-b881-2f1b6d5ea676 (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5fc58b0-2401-4b7e-b353-463a2b0cce03 (dataset): DatasetConfig { id: b5fc58b0-2401-4b7e-b353-463a2b0cce03 (dataset), name: DatasetName { pool_name: ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, baf9141f-641a-49c1-b6ff-f20e74ec60bc (dataset): DatasetConfig { id: baf9141f-641a-49c1-b6ff-f20e74ec60bc (dataset), name: DatasetName { pool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbc39a08-9ac5-42bf-8fe1-72bda5d26fb2 (dataset): DatasetConfig { id: bbc39a08-9ac5-42bf-8fe1-72bda5d26fb2 (dataset), name: DatasetName { pool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, be9e5052-4d67-4762-b71b-e0464a86bf95 (dataset): DatasetConfig { id: be9e5052-4d67-4762-b71b-e0464a86bf95 (dataset), name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c3a20c30-6637-4903-8237-13ed27a33851 (dataset): DatasetConfig { id: c3a20c30-6637-4903-8237-13ed27a33851 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a4b1a2c-0585-4f12-8c9a-b7cf61af774a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c7d5cd8a-6663-4683-8d7e-a4d892e3bddd (dataset): DatasetConfig { id: c7d5cd8a-6663-4683-8d7e-a4d892e3bddd (dataset), name: DatasetName { pool_name: ZpoolName { id: 6032d020-e97f-4442-878e-bcdbe3293876 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db169364-d0ab-4f02-8dd5-b5d0828e9f9c (dataset): DatasetConfig { id: db169364-d0ab-4f02-8dd5-b5d0828e9f9c (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a4b1a2c-0585-4f12-8c9a-b7cf61af774a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e073ef40-938f-4b52-a6c9-fbe023a948fa (dataset): DatasetConfig { id: e073ef40-938f-4b52-a6c9-fbe023a948fa (dataset), name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e227c393-9861-49c4-a8ea-9c1577e37d20 (dataset): DatasetConfig { id: e227c393-9861-49c4-a8ea-9c1577e37d20 (dataset), name: DatasetName { pool_name: ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e465b551-bb47-4457-b2b6-a3b225c67bf7 (dataset): DatasetConfig { id: e465b551-bb47-4457-b2b6-a3b225c67bf7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6032d020-e97f-4442-878e-bcdbe3293876 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e52fff67-67ab-46fd-9e0a-99df81d68c71 (dataset): DatasetConfig { id: e52fff67-67ab-46fd-9e0a-99df81d68c71 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a4b1a2c-0585-4f12-8c9a-b7cf61af774a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e6ae6112-d2c4-419a-9c00-ffa0b683622e (dataset): DatasetConfig { id: e6ae6112-d2c4-419a-9c00-ffa0b683622e (dataset), name: DatasetName { pool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb14215d-1479-41cc-ac30-66283023ca5f (dataset): DatasetConfig { id: eb14215d-1479-41cc-ac30-66283023ca5f (dataset), name: DatasetName { pool_name: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f58e5b5c-a9a2-4254-8218-c2f1efd71116 (dataset): DatasetConfig { id: f58e5b5c-a9a2-4254-8218-c2f1efd71116 (dataset), name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fc8540d0-025d-463f-a04d-b83129f21832 (dataset): DatasetConfig { id: fc8540d0-025d-463f-a04d-b83129f21832 (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe95b7ad-2a1f-4a85-981e-e091d978d009 (dataset): DatasetConfig { id: fe95b7ad-2a1f-4a85-981e-e091d978d009 (dataset), name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4602024-11-14T08:55:44.815ZINFOSledAgent (StorageManager): No ledger in /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4612024-11-14T08:55:44.815ZINFOSledAgent (StorageManager): No ledger in /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4622024-11-14T08:55:44.815ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4632024-11-14T08:55:44.815ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4642024-11-14T08:55:44.815ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/493c27e1-df39-477b-8315-ad9aa5767668/crypt/zone"), full_name: "oxp_493c27e1-df39-477b-8315-ad9aa5767668/crypt/zone" } file = sled-storage/src/manager.rs:1331
4652024-11-14T08:55:44.891ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4662024-11-14T08:55:44.891ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7d1e429d-74f9-4a0f-9382-4b993f07db56/crypt/zone/oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6"), full_name: "oxp_7d1e429d-74f9-4a0f-9382-4b993f07db56/crypt/zone/oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6" } file = sled-storage/src/manager.rs:1331
4672024-11-14T08:55:45.003ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4682024-11-14T08:55:45.003ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6032d020-e97f-4442-878e-bcdbe3293876/crypt/debug"), full_name: "oxp_6032d020-e97f-4442-878e-bcdbe3293876/crypt/debug" } file = sled-storage/src/manager.rs:1331
4692024-11-14T08:55:45.084ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4702024-11-14T08:55:45.084ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_adf8829f-c3eb-4450-b693-c7220506810c/crucible" } file = sled-storage/src/manager.rs:1331
4712024-11-14T08:55:45.186ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4722024-11-14T08:55:45.186ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7d1e429d-74f9-4a0f-9382-4b993f07db56/crucible" } file = sled-storage/src/manager.rs:1331
4732024-11-14T08:55:45.290ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4742024-11-14T08:55:45.290ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d752d0db-efe8-492a-8a25-a56ee29e644b/crypt/zone/oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932"), full_name: "oxp_d752d0db-efe8-492a-8a25-a56ee29e644b/crypt/zone/oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932" } file = sled-storage/src/manager.rs:1331
4752024-11-14T08:55:45.334ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/65d2236a-3110-4d84-aa25-77e21779db87) file = sled-agent/src/probe_manager.rs:231 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
4762024-11-14T08:55:45.403ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4772024-11-14T08:55:45.403ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_371f3005-927c-4e65-88a0-18072469758d/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
4782024-11-14T08:55:45.510ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4792024-11-14T08:55:45.510ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/adf8829f-c3eb-4450-b693-c7220506810c/crypt/zone"), full_name: "oxp_adf8829f-c3eb-4450-b693-c7220506810c/crypt/zone" } file = sled-storage/src/manager.rs:1331
4802024-11-14T08:55:45.587ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4812024-11-14T08:55:45.587ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_adf8829f-c3eb-4450-b693-c7220506810c/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
4822024-11-14T08:55:45.690ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4832024-11-14T08:55:45.691ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d752d0db-efe8-492a-8a25-a56ee29e644b/crypt/debug"), full_name: "oxp_d752d0db-efe8-492a-8a25-a56ee29e644b/crypt/debug" } file = sled-storage/src/manager.rs:1331
4842024-11-14T08:55:45.770ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4852024-11-14T08:55:45.770ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7d1e429d-74f9-4a0f-9382-4b993f07db56/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
4862024-11-14T08:55:45.878ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4872024-11-14T08:55:45.878ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7/crypt/debug"), full_name: "oxp_75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7/crypt/debug" } file = sled-storage/src/manager.rs:1331
4882024-11-14T08:55:45.955ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4892024-11-14T08:55:45.955ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/493c27e1-df39-477b-8315-ad9aa5767668/crypt/debug"), full_name: "oxp_493c27e1-df39-477b-8315-ad9aa5767668/crypt/debug" } file = sled-storage/src/manager.rs:1331
4902024-11-14T08:55:46.032ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4912024-11-14T08:55:46.032ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7d1e429d-74f9-4a0f-9382-4b993f07db56/crypt/zone/oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39"), full_name: "oxp_7d1e429d-74f9-4a0f-9382-4b993f07db56/crypt/zone/oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39" } file = sled-storage/src/manager.rs:1331
4922024-11-14T08:55:46.146ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4932024-11-14T08:55:46.147ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7d1e429d-74f9-4a0f-9382-4b993f07db56/crypt/zone/oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7"), full_name: "oxp_7d1e429d-74f9-4a0f-9382-4b993f07db56/crypt/zone/oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7" } file = sled-storage/src/manager.rs:1331
4942024-11-14T08:55:46.259ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4952024-11-14T08:55:46.259ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/371f3005-927c-4e65-88a0-18072469758d/crypt/zone/oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a"), full_name: "oxp_371f3005-927c-4e65-88a0-18072469758d/crypt/zone/oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a" } file = sled-storage/src/manager.rs:1331
4962024-11-14T08:55:46.336ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/65d2236a-3110-4d84-aa25-77e21779db87) file = sled-agent/src/probe_manager.rs:231 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
4972024-11-14T08:55:46.372ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4982024-11-14T08:55:46.372ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/493c27e1-df39-477b-8315-ad9aa5767668/crypt/zone/oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da"), full_name: "oxp_493c27e1-df39-477b-8315-ad9aa5767668/crypt/zone/oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da" } file = sled-storage/src/manager.rs:1331
4992024-11-14T08:55:46.486ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5002024-11-14T08:55:46.486ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d752d0db-efe8-492a-8a25-a56ee29e644b/crypt/zone/oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e"), full_name: "oxp_d752d0db-efe8-492a-8a25-a56ee29e644b/crypt/zone/oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e" } file = sled-storage/src/manager.rs:1331
5012024-11-14T08:55:46.602ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5022024-11-14T08:55:46.602ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_493c27e1-df39-477b-8315-ad9aa5767668/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5032024-11-14T08:55:46.648ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 17.60113162s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
5042024-11-14T08:55:46.707ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5052024-11-14T08:55:46.707ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7d1e429d-74f9-4a0f-9382-4b993f07db56/crypt/debug"), full_name: "oxp_7d1e429d-74f9-4a0f-9382-4b993f07db56/crypt/debug" } file = sled-storage/src/manager.rs:1331
5062024-11-14T08:55:46.784ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5072024-11-14T08:55:46.784ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/371f3005-927c-4e65-88a0-18072469758d/crypt/debug"), full_name: "oxp_371f3005-927c-4e65-88a0-18072469758d/crypt/debug" } file = sled-storage/src/manager.rs:1331
5082024-11-14T08:55:46.860ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5092024-11-14T08:55:46.860ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6032d020-e97f-4442-878e-bcdbe3293876/crypt/zone/oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f"), full_name: "oxp_6032d020-e97f-4442-878e-bcdbe3293876/crypt/zone/oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f" } file = sled-storage/src/manager.rs:1331
5102024-11-14T08:55:46.974ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5112024-11-14T08:55:46.974ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/371f3005-927c-4e65-88a0-18072469758d/crypt/zone/oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335"), full_name: "oxp_371f3005-927c-4e65-88a0-18072469758d/crypt/zone/oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335" } file = sled-storage/src/manager.rs:1331
5122024-11-14T08:55:47.087ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5132024-11-14T08:55:47.087ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_493c27e1-df39-477b-8315-ad9aa5767668/crucible" } file = sled-storage/src/manager.rs:1331
5142024-11-14T08:55:47.190ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5152024-11-14T08:55:47.190ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d752d0db-efe8-492a-8a25-a56ee29e644b/crypt/zone/oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612"), full_name: "oxp_d752d0db-efe8-492a-8a25-a56ee29e644b/crypt/zone/oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612" } file = sled-storage/src/manager.rs:1331
5162024-11-14T08:55:47.313ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5172024-11-14T08:55:47.314ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/371f3005-927c-4e65-88a0-18072469758d/crypt/zone"), full_name: "oxp_371f3005-927c-4e65-88a0-18072469758d/crypt/zone" } file = sled-storage/src/manager.rs:1331
5182024-11-14T08:55:47.339ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/65d2236a-3110-4d84-aa25-77e21779db87) file = sled-agent/src/probe_manager.rs:231 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
5192024-11-14T08:55:47.392ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5202024-11-14T08:55:47.392ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d752d0db-efe8-492a-8a25-a56ee29e644b/crucible" } file = sled-storage/src/manager.rs:1331
5212024-11-14T08:55:47.496ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5222024-11-14T08:55:47.496ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7/crucible" } file = sled-storage/src/manager.rs:1331
5232024-11-14T08:55:47.596ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5242024-11-14T08:55:47.596ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ef6848de-2e18-4d49-825f-a08523c761f3/crypt/debug"), full_name: "oxp_ef6848de-2e18-4d49-825f-a08523c761f3/crypt/debug" } file = sled-storage/src/manager.rs:1331
5252024-11-14T08:55:47.673ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5262024-11-14T08:55:47.673ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_371f3005-927c-4e65-88a0-18072469758d/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5272024-11-14T08:55:47.779ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5282024-11-14T08:55:47.779ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_adf8829f-c3eb-4450-b693-c7220506810c/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5292024-11-14T08:55:47.881ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5302024-11-14T08:55:47.881ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ef6848de-2e18-4d49-825f-a08523c761f3/crypt/zone"), full_name: "oxp_ef6848de-2e18-4d49-825f-a08523c761f3/crypt/zone" } file = sled-storage/src/manager.rs:1331
5312024-11-14T08:55:47.959ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5322024-11-14T08:55:47.959ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/371f3005-927c-4e65-88a0-18072469758d/crypt/zone/oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0"), full_name: "oxp_371f3005-927c-4e65-88a0-18072469758d/crypt/zone/oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0" } file = sled-storage/src/manager.rs:1331
5332024-11-14T08:55:48.076ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5342024-11-14T08:55:48.076ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ef6848de-2e18-4d49-825f-a08523c761f3/crypt/zone/oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104"), full_name: "oxp_ef6848de-2e18-4d49-825f-a08523c761f3/crypt/zone/oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104" } file = sled-storage/src/manager.rs:1331
5352024-11-14T08:55:48.192ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5362024-11-14T08:55:48.192ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_371f3005-927c-4e65-88a0-18072469758d/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5372024-11-14T08:55:48.300ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5382024-11-14T08:55:48.300ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ef6848de-2e18-4d49-825f-a08523c761f3/crypt/zone/oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555"), full_name: "oxp_ef6848de-2e18-4d49-825f-a08523c761f3/crypt/zone/oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555" } file = sled-storage/src/manager.rs:1331
5392024-11-14T08:55:48.343ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/65d2236a-3110-4d84-aa25-77e21779db87) file = sled-agent/src/probe_manager.rs:231 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
5402024-11-14T08:55:48.437ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5412024-11-14T08:55:48.437ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d752d0db-efe8-492a-8a25-a56ee29e644b/crypt/zone"), full_name: "oxp_d752d0db-efe8-492a-8a25-a56ee29e644b/crypt/zone" } file = sled-storage/src/manager.rs:1331
5422024-11-14T08:55:48.514ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5432024-11-14T08:55:48.514ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/adf8829f-c3eb-4450-b693-c7220506810c/crypt/zone/oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9"), full_name: "oxp_adf8829f-c3eb-4450-b693-c7220506810c/crypt/zone/oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9" } file = sled-storage/src/manager.rs:1331
5442024-11-14T08:55:48.632ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5452024-11-14T08:55:48.632ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7/crypt/zone/oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0"), full_name: "oxp_75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7/crypt/zone/oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0" } file = sled-storage/src/manager.rs:1331
5462024-11-14T08:55:48.747ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5472024-11-14T08:55:48.747ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/adf8829f-c3eb-4450-b693-c7220506810c/crypt/zone/oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8"), full_name: "oxp_adf8829f-c3eb-4450-b693-c7220506810c/crypt/zone/oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8" } file = sled-storage/src/manager.rs:1331
5482024-11-14T08:55:48.864ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5492024-11-14T08:55:48.864ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/371f3005-927c-4e65-88a0-18072469758d/crypt/zone/oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b"), full_name: "oxp_371f3005-927c-4e65-88a0-18072469758d/crypt/zone/oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b" } file = sled-storage/src/manager.rs:1331
5502024-11-14T08:55:48.976ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5512024-11-14T08:55:48.976ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7d1e429d-74f9-4a0f-9382-4b993f07db56/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5522024-11-14T08:55:49.087ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5532024-11-14T08:55:49.087ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8a4b1a2c-0585-4f12-8c9a-b7cf61af774a/crucible" } file = sled-storage/src/manager.rs:1331
5542024-11-14T08:55:49.195ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5552024-11-14T08:55:49.195ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d752d0db-efe8-492a-8a25-a56ee29e644b/crypt/zone/oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7"), full_name: "oxp_d752d0db-efe8-492a-8a25-a56ee29e644b/crypt/zone/oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7" } file = sled-storage/src/manager.rs:1331
5562024-11-14T08:55:49.313ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5572024-11-14T08:55:49.313ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7d1e429d-74f9-4a0f-9382-4b993f07db56/crypt/zone/oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9"), full_name: "oxp_7d1e429d-74f9-4a0f-9382-4b993f07db56/crypt/zone/oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9" } file = sled-storage/src/manager.rs:1331
5582024-11-14T08:55:49.344ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/65d2236a-3110-4d84-aa25-77e21779db87) file = sled-agent/src/probe_manager.rs:231 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
5592024-11-14T08:55:49.433ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5602024-11-14T08:55:49.433ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7d1e429d-74f9-4a0f-9382-4b993f07db56/crypt/zone"), full_name: "oxp_7d1e429d-74f9-4a0f-9382-4b993f07db56/crypt/zone" } file = sled-storage/src/manager.rs:1331
5612024-11-14T08:55:49.513ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5622024-11-14T08:55:49.513ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_371f3005-927c-4e65-88a0-18072469758d/crucible" } file = sled-storage/src/manager.rs:1331
5632024-11-14T08:55:49.619ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5642024-11-14T08:55:49.619ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7/crypt/zone/oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf"), full_name: "oxp_75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7/crypt/zone/oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf" } file = sled-storage/src/manager.rs:1331
5652024-11-14T08:55:49.733ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5662024-11-14T08:55:49.733ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/adf8829f-c3eb-4450-b693-c7220506810c/crypt/zone/oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b"), full_name: "oxp_adf8829f-c3eb-4450-b693-c7220506810c/crypt/zone/oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b" } file = sled-storage/src/manager.rs:1331
5672024-11-14T08:55:49.771ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
5682024-11-14T08:55:49.771ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
5692024-11-14T08:55:49.778ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
5702024-11-14T08:55:49.778ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
5712024-11-14T08:55:49.864ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5722024-11-14T08:55:49.864ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/371f3005-927c-4e65-88a0-18072469758d/crypt/zone/oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74"), full_name: "oxp_371f3005-927c-4e65-88a0-18072469758d/crypt/zone/oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74" } file = sled-storage/src/manager.rs:1331
5732024-11-14T08:55:49.930ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
5742024-11-14T08:55:49.930ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
5752024-11-14T08:55:49.972ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
5762024-11-14T08:55:49.972ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
5772024-11-14T08:55:49.989ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5782024-11-14T08:55:49.989ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7/crypt/zone/oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57"), full_name: "oxp_75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7/crypt/zone/oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57" } file = sled-storage/src/manager.rs:1331
5792024-11-14T08:55:50.025ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
5802024-11-14T08:55:50.025ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
5812024-11-14T08:55:50.047ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
5822024-11-14T08:55:50.047ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
5832024-11-14T08:55:50.116ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5842024-11-14T08:55:50.116ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ef6848de-2e18-4d49-825f-a08523c761f3/crucible" } file = sled-storage/src/manager.rs:1331
5852024-11-14T08:55:50.120ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
5862024-11-14T08:55:50.120ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
5872024-11-14T08:55:50.216ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
5882024-11-14T08:55:50.216ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
5892024-11-14T08:55:50.225ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5902024-11-14T08:55:50.225ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ef6848de-2e18-4d49-825f-a08523c761f3/crypt/zone/oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96"), full_name: "oxp_ef6848de-2e18-4d49-825f-a08523c761f3/crypt/zone/oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96" } file = sled-storage/src/manager.rs:1331
5912024-11-14T08:55:50.254ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:418
5922024-11-14T08:55:50.255ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/65d2236a-3110-4d84-aa25-77e21779db87) file = sled-agent/src/nexus.rs:527 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
5932024-11-14T08:55:50.293ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16618369968633879630 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
5942024-11-14T08:55:50.294ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17502117446889713044 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
5952024-11-14T08:55:50.297ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:686
5962024-11-14T08:55:50.297ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:731
5972024-11-14T08:55:50.297ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:734 uptime = 1
5982024-11-14T08:55:50.297ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:440
5992024-11-14T08:55:50.346ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/65d2236a-3110-4d84-aa25-77e21779db87) file = sled-agent/src/probe_manager.rs:231 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
6002024-11-14T08:55:50.346ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
6012024-11-14T08:55:50.349ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6022024-11-14T08:55:50.350ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/adf8829f-c3eb-4450-b693-c7220506810c/crypt/debug"), full_name: "oxp_adf8829f-c3eb-4450-b693-c7220506810c/crypt/debug" } file = sled-storage/src/manager.rs:1331
6032024-11-14T08:55:50.436ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6042024-11-14T08:55:50.436ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8a4b1a2c-0585-4f12-8c9a-b7cf61af774a/crypt/zone/oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1"), full_name: "oxp_8a4b1a2c-0585-4f12-8c9a-b7cf61af774a/crypt/zone/oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1" } file = sled-storage/src/manager.rs:1331
6052024-11-14T08:55:50.553ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6062024-11-14T08:55:50.553ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6032d020-e97f-4442-878e-bcdbe3293876/crypt/zone"), full_name: "oxp_6032d020-e97f-4442-878e-bcdbe3293876/crypt/zone" } file = sled-storage/src/manager.rs:1331
6072024-11-14T08:55:50.633ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6082024-11-14T08:55:50.633ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8a4b1a2c-0585-4f12-8c9a-b7cf61af774a/crypt/zone"), full_name: "oxp_8a4b1a2c-0585-4f12-8c9a-b7cf61af774a/crypt/zone" } file = sled-storage/src/manager.rs:1331
6092024-11-14T08:55:50.713ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6102024-11-14T08:55:50.713ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/adf8829f-c3eb-4450-b693-c7220506810c/crypt/zone/oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a"), full_name: "oxp_adf8829f-c3eb-4450-b693-c7220506810c/crypt/zone/oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a" } file = sled-storage/src/manager.rs:1331
6112024-11-14T08:55:50.834ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6122024-11-14T08:55:50.834ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7/crypt/zone"), full_name: "oxp_75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7/crypt/zone" } file = sled-storage/src/manager.rs:1331
6132024-11-14T08:55:50.915ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6142024-11-14T08:55:50.915ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6032d020-e97f-4442-878e-bcdbe3293876/crucible" } file = sled-storage/src/manager.rs:1331
6152024-11-14T08:55:51.007ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14851105500590910663 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
6162024-11-14T08:55:51.007ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8864389262755666366 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
6172024-11-14T08:55:51.018ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6182024-11-14T08:55:51.018ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8a4b1a2c-0585-4f12-8c9a-b7cf61af774a/crypt/debug"), full_name: "oxp_8a4b1a2c-0585-4f12-8c9a-b7cf61af774a/crypt/debug" } file = sled-storage/src/manager.rs:1331
6192024-11-14T08:55:51.104ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6202024-11-14T08:55:51.104ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ef6848de-2e18-4d49-825f-a08523c761f3/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
6212024-11-14T08:55:51.215ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6222024-11-14T08:55:51.215ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/493c27e1-df39-477b-8315-ad9aa5767668/crypt/zone/oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688"), full_name: "oxp_493c27e1-df39-477b-8315-ad9aa5767668/crypt/zone/oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688" } file = sled-storage/src/manager.rs:1331
6232024-11-14T08:55:51.334ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6242024-11-14T08:55:51.334ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_adf8829f-c3eb-4450-b693-c7220506810c/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
6252024-11-14T08:55:51.348ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/65d2236a-3110-4d84-aa25-77e21779db87) file = sled-agent/src/probe_manager.rs:231 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
6262024-11-14T08:55:51.443ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6272024-11-14T08:55:51.443ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_371f3005-927c-4e65-88a0-18072469758d/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
6282024-11-14T08:55:51.555ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6292024-11-14T08:55:51.555ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/371f3005-927c-4e65-88a0-18072469758d/crypt/zone/oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459"), full_name: "oxp_371f3005-927c-4e65-88a0-18072469758d/crypt/zone/oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459" } file = sled-storage/src/manager.rs:1331
6302024-11-14T08:55:51.672ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6312024-11-14T08:55:51.672ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6322024-11-14T08:55:51.673ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6332024-11-14T08:55:51.673ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6342024-11-14T08:55:51.673ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6352024-11-14T08:55:51.673ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6362024-11-14T08:55:51.673ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6372024-11-14T08:55:51.673ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6382024-11-14T08:55:51.673ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6392024-11-14T08:55:51.673ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6402024-11-14T08:55:51.673ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6412024-11-14T08:55:51.673ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6422024-11-14T08:55:51.673ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6432024-11-14T08:55:51.673ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6442024-11-14T08:55:51.673ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6452024-11-14T08:55:51.673ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6462024-11-14T08:55:51.673ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6472024-11-14T08:55:51.673ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6482024-11-14T08:55:51.673ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6492024-11-14T08:55:51.673ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6502024-11-14T08:55:51.673ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6512024-11-14T08:55:51.673ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6522024-11-14T08:55:51.673ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6532024-11-14T08:55:51.673ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6542024-11-14T08:55:51.673ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6552024-11-14T08:55:51.673ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:852 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
6562024-11-14T08:55:51.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6861641 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:45020 req_id = 696db9fb-e5b6-4007-9498-0a82d462a92c response_code = 200 uri = /datasets
6572024-11-14T08:55:51.704ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: f0601c15-cf44-46d3-b9aa-36324427c5b0 (service), filesystem_pool: Some(ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 7876d8e5-f244-4867-9c35-6d9384606bc9 (service), filesystem_pool: Some(ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 0f4dacff-88ec-4392-8377-4682964053f6 (service), filesystem_pool: Some(ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
6582024-11-14T08:55:51.704ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53347
6592024-11-14T08:55:51.704ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f0601c15-cf44-46d3-b9aa-36324427c5b0, dataset_name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6602024-11-14T08:55:51.704ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f0601c15-cf44-46d3-b9aa-36324427c5b0, dataset_name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: InternalDns }, responder: ... }
6612024-11-14T08:55:51.738ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7876d8e5-f244-4867-9c35-6d9384606bc9, dataset_name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6622024-11-14T08:55:51.738ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7876d8e5-f244-4867-9c35-6d9384606bc9, dataset_name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: InternalDns }, responder: ... }
6632024-11-14T08:55:51.775ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0f4dacff-88ec-4392-8377-4682964053f6, dataset_name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6642024-11-14T08:55:51.775ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0f4dacff-88ec-4392-8377-4682964053f6, dataset_name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6652024-11-14T08:55:51.808ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6662024-11-14T08:55:51.808ZINFOSledAgent (ServiceManager): No ledger in /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/omicron-zones.json file = common/src/ledger.rs:188
6672024-11-14T08:55:51.808ZINFOSledAgent (ServiceManager): No ledger in /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/omicron-zones.json file = common/src/ledger.rs:188
6682024-11-14T08:55:51.808ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6692024-11-14T08:55:51.852ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6702024-11-14T08:55:51.852ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6712024-11-14T08:55:51.852ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6722024-11-14T08:55:51.908ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0 file = illumos-utils/src/zone.rs:325
6732024-11-14T08:55:51.912ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9 file = illumos-utils/src/zone.rs:325
6742024-11-14T08:55:51.916ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6 file = illumos-utils/src/zone.rs:325
6752024-11-14T08:55:51.928ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0 file = illumos-utils/src/zone.rs:363
6762024-11-14T08:55:51.934ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9 file = illumos-utils/src/zone.rs:363
6772024-11-14T08:55:51.939ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6 file = illumos-utils/src/zone.rs:363
6782024-11-14T08:55:52.255ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/65d2236a-3110-4d84-aa25-77e21779db87) file = sled-agent/src/nexus.rs:527 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
6792024-11-14T08:55:52.350ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/65d2236a-3110-4d84-aa25-77e21779db87) file = sled-agent/src/probe_manager.rs:231 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
6802024-11-14T08:55:53.476ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6812024-11-14T08:55:53.477ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6822024-11-14T08:55:53.477ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0
6832024-11-14T08:55:53.965ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6842024-11-14T08:55:54.446ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6852024-11-14T08:55:54.446ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6862024-11-14T08:55:54.446ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6872024-11-14T08:55:54.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0") failed: Property not found. retry in 69.779018ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0
6882024-11-14T08:55:54.455ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9
6892024-11-14T08:55:54.459ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6
6902024-11-14T08:55:54.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0") failed: Property not found. retry in 81.922841ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0
6912024-11-14T08:55:54.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9") failed: Property not found. retry in 72.141026ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9
6922024-11-14T08:55:54.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6") failed: Property not found. retry in 56.553578ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6
6932024-11-14T08:55:54.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0") failed: Property not found. retry in 265.078535ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0
6942024-11-14T08:55:54.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6") failed: Property not found. retry in 88.610881ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6
6952024-11-14T08:55:54.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9") failed: Property not found. retry in 120.035612ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9
6962024-11-14T08:55:54.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6") failed: Property not found. retry in 150.339373ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6
6972024-11-14T08:55:54.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0") failed: Property not found. retry in 347.087197ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0
6982024-11-14T08:55:54.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9") failed: Property not found. retry in 251.6369ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9
6992024-11-14T08:55:55.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6") failed: Property not found. retry in 363.092599ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6
7002024-11-14T08:55:55.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9") failed: Property not found. retry in 210.370232ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9
7012024-11-14T08:55:55.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0") failed: Property not found. retry in 663.088896ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0
7022024-11-14T08:55:55.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9") failed: Property not found. retry in 735.511439ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9
7032024-11-14T08:55:55.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6") failed: Property not found. retry in 776.980636ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6
7042024-11-14T08:55:55.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0") failed: Property not found. retry in 735.249895ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0
7052024-11-14T08:55:56.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9") failed: Property not found. retry in 889.27446ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9
7062024-11-14T08:55:56.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6") failed: Property not found. retry in 706.00553ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6
7072024-11-14T08:55:56.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0") failed: Property not found. retry in 1.454546648s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0
7082024-11-14T08:55:56.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6") failed: Property not found. retry in 1.085578672s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6
7092024-11-14T08:55:57.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9") failed: Property not found. retry in 1.420267977s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9
7102024-11-14T08:55:58.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6") failed: Property not found. retry in 634.615091ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6
7112024-11-14T08:55:58.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0") failed: Property not found. retry in 1.484148092s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0
7122024-11-14T08:55:58.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9") failed: Property not found. retry in 1.233272101s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9
7132024-11-14T08:55:58.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6") failed: Property not found. retry in 1.042086366s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6
7142024-11-14T08:55:59.781ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_f0601c15-cf44-46d3-b9aa-36324427c5b0
7152024-11-14T08:55:59.781ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_7876d8e5-f244-4867-9c35-6d9384606bc9
7162024-11-14T08:55:59.781ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_0f4dacff-88ec-4392-8377-4682964053f6
7172024-11-14T08:55:59.781ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7182024-11-14T08:55:59.781ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7192024-11-14T08:55:59.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8077388 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53347 req_id = a0432e83-d2ca-4f23-be6e-c0a0e4d25db3 response_code = 204 uri = /omicron-zones
7202024-11-14T08:55:59.783ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7212024-11-14T08:56:00.295ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16618369968633879630 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
7222024-11-14T08:56:00.295ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17502117446889713044 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
7232024-11-14T08:56:00.972ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7242024-11-14T08:56:01.009ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14851105500590910663 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
7252024-11-14T08:56:01.009ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8864389262755666366 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
7262024-11-14T08:56:01.025ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7272024-11-14T08:56:01.077ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:691
7282024-11-14T08:56:01.077ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7292024-11-14T08:56:01.109ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7302024-11-14T08:56:01.111ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7312024-11-14T08:56:01.111ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7322024-11-14T08:56:01.140ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: f0601c15-cf44-46d3-b9aa-36324427c5b0 (service), filesystem_pool: Some(ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 7876d8e5-f244-4867-9c35-6d9384606bc9 (service), filesystem_pool: Some(ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 0f4dacff-88ec-4392-8377-4682964053f6 (service), filesystem_pool: Some(ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 952739a4-a6f9-4e2e-9812-17c43cb1081e (service), filesystem_pool: Some(ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: a4f31692-7816-486d-afd0-d1746b78a706, kind: Service { id: 952739a4-a6f9-4e2e-9812-17c43cb1081e }, name: Name("ntp-952739a4-a6f9-4e2e-9812-17c43cb1081e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 111])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
7332024-11-14T08:56:01.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34039
7342024-11-14T08:56:01.140ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f0601c15-cf44-46d3-b9aa-36324427c5b0, dataset_name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7352024-11-14T08:56:01.140ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f0601c15-cf44-46d3-b9aa-36324427c5b0, dataset_name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: InternalDns }, responder: ... }
7362024-11-14T08:56:01.182ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7876d8e5-f244-4867-9c35-6d9384606bc9, dataset_name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7372024-11-14T08:56:01.182ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7876d8e5-f244-4867-9c35-6d9384606bc9, dataset_name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: InternalDns }, responder: ... }
7382024-11-14T08:56:01.217ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0f4dacff-88ec-4392-8377-4682964053f6, dataset_name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7392024-11-14T08:56:01.217ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0f4dacff-88ec-4392-8377-4682964053f6, dataset_name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7402024-11-14T08:56:01.255ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7412024-11-14T08:56:01.255ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/omicron-zones.json file = common/src/ledger.rs:177
7422024-11-14T08:56:01.255ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/omicron-zones.json file = common/src/ledger.rs:177
7432024-11-14T08:56:01.255ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7442024-11-14T08:56:01.266ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7452024-11-14T08:56:01.297ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7462024-11-14T08:56:01.298ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7472024-11-14T08:56:01.298ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7482024-11-14T08:56:01.327ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 167, 111]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7492024-11-14T08:56:01.327ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7502024-11-14T08:56:01.328ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7512024-11-14T08:56:01.328ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7522024-11-14T08:56:01.328ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7532024-11-14T08:56:01.328ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7542024-11-14T08:56:01.352ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e file = illumos-utils/src/zone.rs:325
7552024-11-14T08:56:01.370ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e file = illumos-utils/src/zone.rs:363
7562024-11-14T08:56:01.998ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7572024-11-14T08:56:01.998ZINFOSledAgent (ServiceManager): Booting oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e
7582024-11-14T08:56:02.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e") failed: Property not found. retry in 34.908879ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e
7592024-11-14T08:56:02.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e") failed: Property not found. retry in 131.34005ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e
7602024-11-14T08:56:02.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e") failed: Property not found. retry in 268.658675ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e
7612024-11-14T08:56:02.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e") failed: Property not found. retry in 216.550999ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e
7622024-11-14T08:56:02.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e") failed: Property not found. retry in 1.01577873s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e
7632024-11-14T08:56:03.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e") failed: Property not found. retry in 1.021521513s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e
7642024-11-14T08:56:04.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e") failed: Property not found. retry in 853.40004ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e
7652024-11-14T08:56:05.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e") failed: Property not found. retry in 786.345953ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e
7662024-11-14T08:56:06.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e") failed: Property not found. retry in 875.295966ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e
7672024-11-14T08:56:07.448ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e
7682024-11-14T08:56:07.448ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7692024-11-14T08:56:07.449ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7702024-11-14T08:56:07.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6308946 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:34039 req_id = 2caaca5c-0e1e-4208-8ea2-5588d2a23fab response_code = 204 uri = /omicron-zones
7712024-11-14T08:56:07.452ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:732
7722024-11-14T08:56:07.481ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7732024-11-14T08:56:07.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55649
7742024-11-14T08:56:07.489ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7752024-11-14T08:56:07.489ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8076 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55649 req_id = 8972c88d-0503-4ee3-8b24-151610795c85 response_code = 500 uri = /timesync
7762024-11-14T08:56:07.492ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7772024-11-14T08:56:07.575ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7782024-11-14T08:56:07.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35764
7792024-11-14T08:56:09.583ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7802024-11-14T08:56:09.583ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 2008671 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35764 req_id = 12c91457-e682-4e0f-b290-ac9197063549 response_code = 500 uri = /timesync
7812024-11-14T08:56:09.586ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7822024-11-14T08:56:09.686ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1346230234957023094 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
7832024-11-14T08:56:09.751ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7842024-11-14T08:56:09.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38890
7852024-11-14T08:56:09.759ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7862024-11-14T08:56:09.759ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8084 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38890 req_id = f0d0cbaa-4276-46a3-874a-ebbb08121043 response_code = 500 uri = /timesync
7872024-11-14T08:56:09.761ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7882024-11-14T08:56:09.778ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4654442043623088791 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
7892024-11-14T08:56:09.784ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16953824667606466417 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
7902024-11-14T08:56:09.901ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7912024-11-14T08:56:09.901ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63437
7922024-11-14T08:56:10.297ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16618369968633879630 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
7932024-11-14T08:56:10.297ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17502117446889713044 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
7942024-11-14T08:56:11.010ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14851105500590910663 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
7952024-11-14T08:56:11.010ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8864389262755666366 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
7962024-11-14T08:56:13.910ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_952739a4-a6f9-4e2e-9812-17c43cb1081e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7972024-11-14T08:56:13.910ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008568 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63437 req_id = b19f2af9-cb6e-4fad-8265-e3ccb272b53c response_code = 500 uri = /timesync
7982024-11-14T08:56:13.913ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7992024-11-14T08:56:14.164ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8002024-11-14T08:56:14.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33207
8012024-11-14T08:56:14.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7768 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33207 req_id = 07a0668c-1fd8-4eb5-acce-9cef07c5e5bd response_code = 200 uri = /timesync
8022024-11-14T08:56:14.174ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8032024-11-14T08:56:14.174ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8042024-11-14T08:56:14.342ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8052024-11-14T08:56:14.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36350
8062024-11-14T08:56:14.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7919 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36350 req_id = baf11315-e74a-4048-a6fd-14e5832f3d6f response_code = 200 uri = /timesync
8072024-11-14T08:56:14.354ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8082024-11-14T08:56:14.354ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8092024-11-14T08:56:14.644ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8102024-11-14T08:56:14.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61668
8112024-11-14T08:56:14.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7924 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61668 req_id = 2ed051de-446c-4840-99ba-6402a9e19a28 response_code = 200 uri = /timesync
8122024-11-14T08:56:14.654ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8132024-11-14T08:56:14.654ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8142024-11-14T08:56:14.910ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8152024-11-14T08:56:14.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33687
8162024-11-14T08:56:14.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7397 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33687 req_id = e9ffb931-6cfd-48dc-bb95-86a5f92b5178 response_code = 200 uri = /timesync
8172024-11-14T08:56:14.919ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8182024-11-14T08:56:14.919ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8192024-11-14T08:56:15.303ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8202024-11-14T08:56:15.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40145
8212024-11-14T08:56:15.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7996 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40145 req_id = 519c01af-b103-42ef-b39f-db0381701977 response_code = 200 uri = /timesync
8222024-11-14T08:56:15.313ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731574573.9095645, correction: 0.068584487 } file = sled-agent/src/rack_setup/service.rs:740
8232024-11-14T08:56:15.313ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8242024-11-14T08:56:15.918ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8252024-11-14T08:56:15.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49577
8262024-11-14T08:56:15.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8928 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49577 req_id = 27617f13-c251-45df-a0e8-7c5d11cf256c response_code = 200 uri = /timesync
8272024-11-14T08:56:15.928ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731574573.9095645, correction: 0.06431675 } file = sled-agent/src/rack_setup/service.rs:740
8282024-11-14T08:56:15.928ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8292024-11-14T08:56:16.733ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8302024-11-14T08:56:16.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65390
8312024-11-14T08:56:16.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7983 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65390 req_id = f3acf8d2-5b97-421d-bada-9df0b03f06e7 response_code = 200 uri = /timesync
8322024-11-14T08:56:16.744ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731574573.9095645, correction: 0.062936231 } file = sled-agent/src/rack_setup/service.rs:740
8332024-11-14T08:56:16.744ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8342024-11-14T08:56:17.130ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8352024-11-14T08:56:17.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63853
8362024-11-14T08:56:17.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8710 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63853 req_id = 2d85a687-4a4b-4dee-b6d7-0948b89e8d7d response_code = 200 uri = /timesync
8372024-11-14T08:56:17.142ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731574573.9095645, correction: 0.061862074 } file = sled-agent/src/rack_setup/service.rs:740
8382024-11-14T08:56:17.142ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8392024-11-14T08:56:17.459ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11291461523760881230 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
8402024-11-14T08:56:17.460ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11792343319268173902 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
8412024-11-14T08:56:17.950ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8422024-11-14T08:56:17.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33511
8432024-11-14T08:56:17.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8870 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33511 req_id = 8c519a2b-b75b-4413-b6b6-af3242ec07e9 response_code = 200 uri = /timesync
8442024-11-14T08:56:17.962ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731574573.9095645, correction: 0.060278535 } file = sled-agent/src/rack_setup/service.rs:740
8452024-11-14T08:56:17.962ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8462024-11-14T08:56:18.526ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8472024-11-14T08:56:18.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62654
8482024-11-14T08:56:18.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10608 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62654 req_id = 61136aae-80ab-4a51-8e15-4fe29bca5f2d response_code = 200 uri = /timesync
8492024-11-14T08:56:18.539ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731574573.9095645, correction: 0.05892206 } file = sled-agent/src/rack_setup/service.rs:740
8502024-11-14T08:56:18.539ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8512024-11-14T08:56:19.299ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 326.343273ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
8522024-11-14T08:56:19.701ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1346230234957023094 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
8532024-11-14T08:56:19.793ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4654442043623088791 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
8542024-11-14T08:56:19.799ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16953824667606466417 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
8552024-11-14T08:56:19.982ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43080
8562024-11-14T08:56:19.983ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43080 req_id = 17d8d5cb-50c2-426c-8433-8923912750ef response_code = 200 uri = /baseboard
8572024-11-14T08:56:20.052ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8582024-11-14T08:56:20.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41245
8592024-11-14T08:56:20.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9620 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41245 req_id = da16f48b-ccad-4caf-baff-415f12b80401 response_code = 200 uri = /timesync
8602024-11-14T08:56:20.064ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2310930948, ip_addr: 137.190.2.4, stratum: 3, ref_time: 1731574578.949728, correction: 0.054106966 } file = sled-agent/src/rack_setup/service.rs:740
8612024-11-14T08:56:20.064ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8622024-11-14T08:56:20.314ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16618369968633879630 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
8632024-11-14T08:56:20.314ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17502117446889713044 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
8642024-11-14T08:56:21.001ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8652024-11-14T08:56:21.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46280
8662024-11-14T08:56:21.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8674 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46280 req_id = 86ef599c-5634-4acb-9fd9-6cb70fab8784 response_code = 200 uri = /timesync
8672024-11-14T08:56:21.014ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2310930948, ip_addr: 137.190.2.4, stratum: 3, ref_time: 1731574579.5756693, correction: 0.051267684 } file = sled-agent/src/rack_setup/service.rs:740
8682024-11-14T08:56:21.014ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8692024-11-14T08:56:21.029ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14851105500590910663 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
8702024-11-14T08:56:21.029ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8864389262755666366 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
8712024-11-14T08:56:22.994ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8722024-11-14T08:56:22.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40973
8732024-11-14T08:56:23.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21432 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40973 req_id = 3a22901a-85d6-4dae-b216-bf50f5057772 response_code = 200 uri = /timesync
8742024-11-14T08:56:23.020ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2310930948, ip_addr: 137.190.2.4, stratum: 3, ref_time: 1731574582.3309414, correction: 0.046212614 } file = sled-agent/src/rack_setup/service.rs:740
8752024-11-14T08:56:23.020ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1425
8762024-11-14T08:56:23.049ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: f0601c15-cf44-46d3-b9aa-36324427c5b0 (service), filesystem_pool: Some(ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 7876d8e5-f244-4867-9c35-6d9384606bc9 (service), filesystem_pool: Some(ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 0f4dacff-88ec-4392-8377-4682964053f6 (service), filesystem_pool: Some(ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 952739a4-a6f9-4e2e-9812-17c43cb1081e (service), filesystem_pool: Some(ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: a4f31692-7816-486d-afd0-d1746b78a706, kind: Service { id: 952739a4-a6f9-4e2e-9812-17c43cb1081e }, name: Name("ntp-952739a4-a6f9-4e2e-9812-17c43cb1081e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 111])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 93b22b84-9c41-41da-bde4-af11f2e58e74 (service), filesystem_pool: Some(ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External } } } }, OmicronZoneConfig { id: f72edb1a-4b08-45bf-a24a-87fb8da7c05b (service), filesystem_pool: Some(ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External } } } }, OmicronZoneConfig { id: a6afa52f-6167-495d-956f-4dce06cd25c9 (service), filesystem_pool: Some(ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External } } } }, OmicronZoneConfig { id: 16a8a993-bd1a-4f46-a1a2-98ae74c09688 (service), filesystem_pool: Some(ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External } } } }, OmicronZoneConfig { id: 57dda902-1c96-4121-bf86-5394f94a3555 (service), filesystem_pool: Some(ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
8772024-11-14T08:56:23.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49639
8782024-11-14T08:56:23.049ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f0601c15-cf44-46d3-b9aa-36324427c5b0, dataset_name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8792024-11-14T08:56:23.049ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f0601c15-cf44-46d3-b9aa-36324427c5b0, dataset_name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: InternalDns }, responder: ... }
8802024-11-14T08:56:23.085ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7876d8e5-f244-4867-9c35-6d9384606bc9, dataset_name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8812024-11-14T08:56:23.085ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7876d8e5-f244-4867-9c35-6d9384606bc9, dataset_name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: InternalDns }, responder: ... }
8822024-11-14T08:56:23.121ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0f4dacff-88ec-4392-8377-4682964053f6, dataset_name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8832024-11-14T08:56:23.121ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0f4dacff-88ec-4392-8377-4682964053f6, dataset_name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8842024-11-14T08:56:23.155ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 93b22b84-9c41-41da-bde4-af11f2e58e74, dataset_name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8852024-11-14T08:56:23.155ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 93b22b84-9c41-41da-bde4-af11f2e58e74, dataset_name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: Cockroach }, responder: ... }
8862024-11-14T08:56:23.190ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f72edb1a-4b08-45bf-a24a-87fb8da7c05b, dataset_name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8872024-11-14T08:56:23.190ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f72edb1a-4b08-45bf-a24a-87fb8da7c05b, dataset_name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: Cockroach }, responder: ... }
8882024-11-14T08:56:23.224ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a6afa52f-6167-495d-956f-4dce06cd25c9, dataset_name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8892024-11-14T08:56:23.224ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a6afa52f-6167-495d-956f-4dce06cd25c9, dataset_name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8902024-11-14T08:56:23.258ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 16a8a993-bd1a-4f46-a1a2-98ae74c09688, dataset_name: DatasetName { pool_name: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8912024-11-14T08:56:23.258ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 16a8a993-bd1a-4f46-a1a2-98ae74c09688, dataset_name: DatasetName { pool_name: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8922024-11-14T08:56:23.293ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 57dda902-1c96-4121-bf86-5394f94a3555, dataset_name: DatasetName { pool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8932024-11-14T08:56:23.293ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 57dda902-1c96-4121-bf86-5394f94a3555, dataset_name: DatasetName { pool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8942024-11-14T08:56:23.326ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8952024-11-14T08:56:23.326ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/omicron-zones.json file = common/src/ledger.rs:177
8962024-11-14T08:56:23.327ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/omicron-zones.json file = common/src/ledger.rs:177
8972024-11-14T08:56:23.327ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8982024-11-14T08:56:23.408ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8992024-11-14T08:56:23.409ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9002024-11-14T08:56:23.409ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9012024-11-14T08:56:23.409ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9022024-11-14T08:56:23.409ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9032024-11-14T08:56:23.499ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688 file = illumos-utils/src/zone.rs:325
9042024-11-14T08:56:23.504ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555 file = illumos-utils/src/zone.rs:325
9052024-11-14T08:56:23.509ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74 file = illumos-utils/src/zone.rs:325
9062024-11-14T08:56:23.514ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b file = illumos-utils/src/zone.rs:325
9072024-11-14T08:56:23.518ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9 file = illumos-utils/src/zone.rs:325
9082024-11-14T08:56:23.523ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688 file = illumos-utils/src/zone.rs:363
9092024-11-14T08:56:23.528ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555 file = illumos-utils/src/zone.rs:363
9102024-11-14T08:56:23.533ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74 file = illumos-utils/src/zone.rs:363
9112024-11-14T08:56:23.537ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b file = illumos-utils/src/zone.rs:363
9122024-11-14T08:56:23.541ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9 file = illumos-utils/src/zone.rs:363
9132024-11-14T08:56:26.414ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='16a8a993-bd1a-4f46-a1a2-98ae74c09688'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9142024-11-14T08:56:26.415ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
9152024-11-14T08:56:26.421ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='f72edb1a-4b08-45bf-a24a-87fb8da7c05b'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9162024-11-14T08:56:26.421ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='a6afa52f-6167-495d-956f-4dce06cd25c9'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9172024-11-14T08:56:26.421ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b
9182024-11-14T08:56:26.425ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9
9192024-11-14T08:56:26.499ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='93b22b84-9c41-41da-bde4-af11f2e58e74'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9202024-11-14T08:56:26.499ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74
9212024-11-14T08:56:26.527ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='57dda902-1c96-4121-bf86-5394f94a3555'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9222024-11-14T08:56:26.527ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555
9232024-11-14T08:56:26.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b") failed: Property not found. retry in 32.027781ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b
9242024-11-14T08:56:26.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688") failed: Property not found. retry in 30.992321ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
9252024-11-14T08:56:26.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9") failed: Property not found. retry in 72.92014ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9
9262024-11-14T08:56:26.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b") failed: Property not found. retry in 82.613051ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b
9272024-11-14T08:56:26.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688") failed: Property not found. retry in 53.170326ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
9282024-11-14T08:56:26.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688") failed: Property not found. retry in 206.443092ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
9292024-11-14T08:56:27.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b") failed: Property not found. retry in 145.9901ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b
9302024-11-14T08:56:27.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9") failed: Property not found. retry in 137.83802ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9
9312024-11-14T08:56:27.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74") failed: Property not found. retry in 31.972208ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74
9322024-11-14T08:56:27.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b") failed: Property not found. retry in 497.968198ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b
9332024-11-14T08:56:27.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9") failed: Property not found. retry in 189.867905ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9
9342024-11-14T08:56:27.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688") failed: Property not found. retry in 266.513911ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
9352024-11-14T08:56:27.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555") failed: Property not found. retry in 47.935881ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555
9362024-11-14T08:56:27.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74") failed: Property not found. retry in 111.448496ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74
9372024-11-14T08:56:28.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9") failed: Property not found. retry in 571.095137ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9
9382024-11-14T08:56:28.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688") failed: Property not found. retry in 512.369667ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
9392024-11-14T08:56:28.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555") failed: Property not found. retry in 141.998893ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555
9402024-11-14T08:56:28.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74") failed: Property not found. retry in 195.734397ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74
9412024-11-14T08:56:28.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b") failed: Property not found. retry in 1.034242884s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b
9422024-11-14T08:56:28.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9") failed: Property not found. retry in 710.092352ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9
9432024-11-14T08:56:28.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555") failed: Property not found. retry in 297.167651ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555
9442024-11-14T08:56:28.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688") failed: Property not found. retry in 616.150689ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
9452024-11-14T08:56:29.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74") failed: Property not found. retry in 336.466964ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74
9462024-11-14T08:56:29.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555") failed: Property not found. retry in 459.70167ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555
9472024-11-14T08:56:29.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74") failed: Property not found. retry in 523.737976ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74
9482024-11-14T08:56:29.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688") failed: Property not found. retry in 634.390859ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
9492024-11-14T08:56:29.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9") failed: Property not found. retry in 813.351748ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9
9502024-11-14T08:56:29.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555") failed: Property not found. retry in 475.022415ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555
9512024-11-14T08:56:29.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74") failed: Property not found. retry in 1.205342852s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74
9522024-11-14T08:56:29.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b") failed: Property not found. retry in 1.304704072s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b
9532024-11-14T08:56:30.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555") failed: Property not found. retry in 1.447357947s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555
9542024-11-14T08:56:30.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688") failed: Property not found. retry in 1.391338335s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
9552024-11-14T08:56:30.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9") failed: Property not found. retry in 874.693239ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9
9562024-11-14T08:56:31.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74") failed: Property not found. retry in 637.511678ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74
9572024-11-14T08:56:31.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b") failed: Property not found. retry in 579.823738ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b
9582024-11-14T08:56:31.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9") failed: Property not found. retry in 961.226879ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9
9592024-11-14T08:56:31.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555") failed: Property not found. retry in 1.439649183s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555
9602024-11-14T08:56:31.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688") failed: Property not found. retry in 1.176336547s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
9612024-11-14T08:56:31.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74") failed: Property not found. retry in 662.162975ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74
9622024-11-14T08:56:31.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b") failed: Property not found. retry in 966.019684ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b
9632024-11-14T08:56:32.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9") failed: Property not found. retry in 1.365337944s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9
9642024-11-14T08:56:32.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74") failed: Property not found. retry in 1.176833547s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74
9652024-11-14T08:56:32.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b") failed: Property not found. retry in 1.494747744s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b
9662024-11-14T08:56:32.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688") failed: Property not found. retry in 748.402656ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
9672024-11-14T08:56:33.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555") failed: Property not found. retry in 610.423684ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555
9682024-11-14T08:56:33.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688") failed: Property not found. retry in 1.40524049s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
9692024-11-14T08:56:33.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74") failed: Property not found. retry in 844.900449ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74
9702024-11-14T08:56:33.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9") failed: Property not found. retry in 552.678983ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9
9712024-11-14T08:56:33.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555") failed: Property not found. retry in 1.073452842s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555
9722024-11-14T08:56:34.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9") failed: Property not found. retry in 1.381285943s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9
9732024-11-14T08:56:34.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b") failed: Property not found. retry in 1.281149667s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b
9742024-11-14T08:56:34.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74") failed: Property not found. retry in 912.213425ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74
9752024-11-14T08:56:34.703ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 649.641555ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
9762024-11-14T08:56:34.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555") failed: Property not found. retry in 816.623723ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555
9772024-11-14T08:56:35.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688") failed: Property not found. retry in 880.754349ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
9782024-11-14T08:56:35.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74") failed: Property not found. retry in 1.202968296s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74
9792024-11-14T08:56:35.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b") failed: Property not found. retry in 910.861889ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b
9802024-11-14T08:56:35.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9") failed: Property not found. retry in 1.268120605s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9
9812024-11-14T08:56:35.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688") failed: Property not found. retry in 700.874414ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
9822024-11-14T08:56:36.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b") failed: Property not found. retry in 1.165648715s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b
9832024-11-14T08:56:36.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74") failed: Property not found. retry in 1.009121242s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74
9842024-11-14T08:56:36.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688") failed: Property not found. retry in 1.290733215s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
9852024-11-14T08:56:36.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9") failed: Property not found. retry in 1.146237138s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9
9862024-11-14T08:56:37.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74") failed: Property not found. retry in 851.588306ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74
9872024-11-14T08:56:37.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b") failed: Property not found. retry in 1.398719574s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b
9882024-11-14T08:56:37.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688") failed: Property not found. retry in 675.514357ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
9892024-11-14T08:56:38.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9") failed: Property not found. retry in 593.535085ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9
9902024-11-14T08:56:38.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74") failed: Property not found. retry in 709.919034ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74
9912024-11-14T08:56:38.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688") failed: Property not found. retry in 837.551715ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
9922024-11-14T08:56:38.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9") failed: Property not found. retry in 1.27095389s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9
9932024-11-14T08:56:39.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b") failed: Property not found. retry in 1.247665316s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b
9942024-11-14T08:56:39.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74") failed: Property not found. retry in 1.133299105s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74
9952024-11-14T08:56:39.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688") failed: Property not found. retry in 1.370430457s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
9962024-11-14T08:56:39.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9") failed: Property not found. retry in 708.390305ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9
9972024-11-14T08:56:40.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b") failed: Property not found. retry in 609.016614ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b
9982024-11-14T08:56:40.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74") failed: Property not found. retry in 992.634964ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74
9992024-11-14T08:56:40.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9") failed: Property not found. retry in 983.623868ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9
10002024-11-14T08:56:40.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688") failed: Property not found. retry in 559.839638ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
10012024-11-14T08:56:40.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b") failed: Property not found. retry in 519.538872ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b
10022024-11-14T08:56:41.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74") failed: Property not found. retry in 1.499507007s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74
10032024-11-14T08:56:41.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688") failed: Property not found. retry in 1.192240529s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
10042024-11-14T08:56:41.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b") failed: Property not found. retry in 1.29618657s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b
10052024-11-14T08:56:41.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9") failed: Property not found. retry in 963.692999ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9
10062024-11-14T08:56:42.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688") failed: Property not found. retry in 612.498419ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
10072024-11-14T08:56:42.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9") failed: Property not found. retry in 1.385292745s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9
10082024-11-14T08:56:42.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b") failed: Property not found. retry in 858.287561ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b
10092024-11-14T08:56:42.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74") failed: Property not found. retry in 1.152757997s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74
10102024-11-14T08:56:43.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688") failed: Property not found. retry in 592.006473ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
10112024-11-14T08:56:43.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b") failed: Property not found. retry in 1.499177201s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b
10122024-11-14T08:56:43.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688") failed: Property not found. retry in 569.984073ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
10132024-11-14T08:56:44.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9") failed: Property not found. retry in 789.251424ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9
10142024-11-14T08:56:44.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74") failed: Property not found. retry in 1.418463949s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74
10152024-11-14T08:56:44.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688") failed: Property not found. retry in 1.497587754s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
10162024-11-14T08:56:44.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9") failed: Property not found. retry in 1.270842418s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9
10172024-11-14T08:56:46.142ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_16a8a993-bd1a-4f46-a1a2-98ae74c09688
10182024-11-14T08:56:46.142ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_57dda902-1c96-4121-bf86-5394f94a3555
10192024-11-14T08:56:46.142ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_93b22b84-9c41-41da-bde4-af11f2e58e74
10202024-11-14T08:56:46.142ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_f72edb1a-4b08-45bf-a24a-87fb8da7c05b
10212024-11-14T08:56:46.142ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_a6afa52f-6167-495d-956f-4dce06cd25c9
10222024-11-14T08:56:46.142ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10232024-11-14T08:56:46.142ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10242024-11-14T08:56:46.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 23046975 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:49639 req_id = c5a59f8c-c8ba-4ba0-a82e-0556aaecda71 response_code = 204 uri = /omicron-zones
10252024-11-14T08:56:46.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41700
10262024-11-14T08:56:46.213ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::6]:32221 file = sled-agent/src/services.rs:3743
10272024-11-14T08:56:52.375ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 808.946499ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
10282024-11-14T08:56:52.606ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63079
10292024-11-14T08:56:52.606ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63079 req_id = 64b8dfe8-8fe3-496b-ada9-e18ab2401af2 response_code = 200 uri = /baseboard
10302024-11-14T08:57:00.284ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
10312024-11-14T08:57:08.227ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.866425746s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
10322024-11-14T08:57:11.140ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
10332024-11-14T08:57:11.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24964666 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:41700 req_id = 04a6862d-e613-4dc9-8089-c1fefc356b91 response_code = 204 uri = /cockroachdb
10342024-11-14T08:57:11.173ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: f0601c15-cf44-46d3-b9aa-36324427c5b0 (service), filesystem_pool: Some(ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 7876d8e5-f244-4867-9c35-6d9384606bc9 (service), filesystem_pool: Some(ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 0f4dacff-88ec-4392-8377-4682964053f6 (service), filesystem_pool: Some(ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 952739a4-a6f9-4e2e-9812-17c43cb1081e (service), filesystem_pool: Some(ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: a4f31692-7816-486d-afd0-d1746b78a706, kind: Service { id: 952739a4-a6f9-4e2e-9812-17c43cb1081e }, name: Name("ntp-952739a4-a6f9-4e2e-9812-17c43cb1081e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 111])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 93b22b84-9c41-41da-bde4-af11f2e58e74 (service), filesystem_pool: Some(ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External } } } }, OmicronZoneConfig { id: f72edb1a-4b08-45bf-a24a-87fb8da7c05b (service), filesystem_pool: Some(ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External } } } }, OmicronZoneConfig { id: a6afa52f-6167-495d-956f-4dce06cd25c9 (service), filesystem_pool: Some(ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External } } } }, OmicronZoneConfig { id: 16a8a993-bd1a-4f46-a1a2-98ae74c09688 (service), filesystem_pool: Some(ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External } } } }, OmicronZoneConfig { id: 57dda902-1c96-4121-bf86-5394f94a3555 (service), filesystem_pool: Some(ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External } } } }, OmicronZoneConfig { id: ef32bdd5-939a-4ab0-a70a-6f004e97691b (service), filesystem_pool: Some(ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 208292a9-20b7-485e-95b8-8fa301192abc, kind: Service { id: ef32bdd5-939a-4ab0-a70a-6f004e97691b }, name: Name("external-dns-ef32bdd5-939a-4ab0-a70a-6f004e97691b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 49])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: e0fbd02e-9643-47c5-9261-dd03abc268a8 (service), filesystem_pool: Some(ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 7b6a42b1-a060-4782-a598-da956f0e54bf, kind: Service { id: e0fbd02e-9643-47c5-9261-dd03abc268a8 }, name: Name("external-dns-e0fbd02e-9643-47c5-9261-dd03abc268a8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: d3dd4036-6839-48d6-8f36-e642d9b3e6c0 (service), filesystem_pool: Some(ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 3d08f9bf-1395-4918-83ef-e9bf23bb54cc, kind: Service { id: d3dd4036-6839-48d6-8f36-e642d9b3e6c0 }, name: Name("nexus-d3dd4036-6839-48d6-8f36-e642d9b3e6c0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 97])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: b933d23e-28f4-4f5e-9ad9-9694702ed335 (service), filesystem_pool: Some(ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: eb09bf8b-0a0a-43d0-8fab-de971f1991ea, kind: Service { id: b933d23e-28f4-4f5e-9ad9-9694702ed335 }, name: Name("nexus-b933d23e-28f4-4f5e-9ad9-9694702ed335"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 484a1c50-302f-49ec-9214-2179c2ff7104 (service), filesystem_pool: Some(ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: f73311b5-bba3-40b6-b24a-8c3229a71a49, kind: Service { id: 484a1c50-302f-49ec-9214-2179c2ff7104 }, name: Name("nexus-484a1c50-302f-49ec-9214-2179c2ff7104"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 487ff140-60d3-41ba-8767-caa53806d612 (service), filesystem_pool: Some(ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 2a6883f8-ec62-4596-8432-b355f1bcf459 (service), filesystem_pool: Some(ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External } } } }, OmicronZoneConfig { id: 4b55850d-21aa-4517-8f88-047ba02d9bbf (service), filesystem_pool: Some(ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: e0a01057-219f-41cb-a79d-4a4fe7ac4b39 (service), filesystem_pool: Some(ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 6482a797-acc5-4429-a69d-994bb976d932 (service), filesystem_pool: Some(ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: de8d096d-77dd-4078-8cf4-d9c4c50a402a (service), filesystem_pool: Some(ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External } } } }, OmicronZoneConfig { id: fb28afbb-471d-45de-9b44-66acd21dfe6a (service), filesystem_pool: Some(ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External } } } }, OmicronZoneConfig { id: 583b4ecb-2b33-44c9-9d2e-0a024470bae7 (service), filesystem_pool: Some(ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External } } } }, OmicronZoneConfig { id: 37b94fe2-7e49-4f8b-ab73-391d62dac7da (service), filesystem_pool: Some(ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External } } } }, OmicronZoneConfig { id: 246c15d9-f807-4711-aeea-96d95a3a4f96 (service), filesystem_pool: Some(ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 990412ff-f4f5-45ab-985c-d9f6540d957f (service), filesystem_pool: Some(ZpoolName { id: 6032d020-e97f-4442-878e-bcdbe3293876 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6032d020-e97f-4442-878e-bcdbe3293876 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1e1dc082-3cc7-4b01-9b4d-6665f49367f1 (service), filesystem_pool: Some(ZpoolName { id: 8a4b1a2c-0585-4f12-8c9a-b7cf61af774a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8a4b1a2c-0585-4f12-8c9a-b7cf61af774a (zpool), kind: External } } } }, OmicronZoneConfig { id: fea12524-8ceb-44e9-ad92-7e4bbea8d7d7 (service), filesystem_pool: Some(ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External } } } }, OmicronZoneConfig { id: d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57 (service), filesystem_pool: Some(ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
10352024-11-14T08:57:11.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56192
10362024-11-14T08:57:11.174ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f0601c15-cf44-46d3-b9aa-36324427c5b0, dataset_name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10372024-11-14T08:57:11.174ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f0601c15-cf44-46d3-b9aa-36324427c5b0, dataset_name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: InternalDns }, responder: ... }
10382024-11-14T08:57:11.232ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7876d8e5-f244-4867-9c35-6d9384606bc9, dataset_name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10392024-11-14T08:57:11.232ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7876d8e5-f244-4867-9c35-6d9384606bc9, dataset_name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: InternalDns }, responder: ... }
10402024-11-14T08:57:11.280ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0f4dacff-88ec-4392-8377-4682964053f6, dataset_name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10412024-11-14T08:57:11.280ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0f4dacff-88ec-4392-8377-4682964053f6, dataset_name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10422024-11-14T08:57:11.325ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 93b22b84-9c41-41da-bde4-af11f2e58e74, dataset_name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10432024-11-14T08:57:11.325ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 93b22b84-9c41-41da-bde4-af11f2e58e74, dataset_name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: Cockroach }, responder: ... }
10442024-11-14T08:57:11.369ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f72edb1a-4b08-45bf-a24a-87fb8da7c05b, dataset_name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10452024-11-14T08:57:11.369ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f72edb1a-4b08-45bf-a24a-87fb8da7c05b, dataset_name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: Cockroach }, responder: ... }
10462024-11-14T08:57:11.412ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a6afa52f-6167-495d-956f-4dce06cd25c9, dataset_name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10472024-11-14T08:57:11.412ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a6afa52f-6167-495d-956f-4dce06cd25c9, dataset_name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10482024-11-14T08:57:11.455ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 16a8a993-bd1a-4f46-a1a2-98ae74c09688, dataset_name: DatasetName { pool_name: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10492024-11-14T08:57:11.455ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 16a8a993-bd1a-4f46-a1a2-98ae74c09688, dataset_name: DatasetName { pool_name: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10502024-11-14T08:57:11.505ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 57dda902-1c96-4121-bf86-5394f94a3555, dataset_name: DatasetName { pool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10512024-11-14T08:57:11.505ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 57dda902-1c96-4121-bf86-5394f94a3555, dataset_name: DatasetName { pool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10522024-11-14T08:57:11.555ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ef32bdd5-939a-4ab0-a70a-6f004e97691b, dataset_name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10532024-11-14T08:57:11.555ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ef32bdd5-939a-4ab0-a70a-6f004e97691b, dataset_name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10542024-11-14T08:57:11.609ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e0fbd02e-9643-47c5-9261-dd03abc268a8, dataset_name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10552024-11-14T08:57:11.609ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e0fbd02e-9643-47c5-9261-dd03abc268a8, dataset_name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10562024-11-14T08:57:11.655ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2a6883f8-ec62-4596-8432-b355f1bcf459, dataset_name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
10572024-11-14T08:57:11.655ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 2a6883f8-ec62-4596-8432-b355f1bcf459, dataset_name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10582024-11-14T08:57:11.709ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: de8d096d-77dd-4078-8cf4-d9c4c50a402a, dataset_name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10592024-11-14T08:57:11.709ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: de8d096d-77dd-4078-8cf4-d9c4c50a402a, dataset_name: DatasetName { pool_name: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, kind: Crucible }, responder: ... }
10602024-11-14T08:57:11.766ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fb28afbb-471d-45de-9b44-66acd21dfe6a, dataset_name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10612024-11-14T08:57:11.766ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: fb28afbb-471d-45de-9b44-66acd21dfe6a, dataset_name: DatasetName { pool_name: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, kind: Crucible }, responder: ... }
10622024-11-14T08:57:11.813ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 583b4ecb-2b33-44c9-9d2e-0a024470bae7, dataset_name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10632024-11-14T08:57:11.813ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 583b4ecb-2b33-44c9-9d2e-0a024470bae7, dataset_name: DatasetName { pool_name: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, kind: Crucible }, responder: ... }
10642024-11-14T08:57:11.866ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 37b94fe2-7e49-4f8b-ab73-391d62dac7da, dataset_name: DatasetName { pool_name: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10652024-11-14T08:57:11.866ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 37b94fe2-7e49-4f8b-ab73-391d62dac7da, dataset_name: DatasetName { pool_name: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }, kind: Crucible }, responder: ... }
10662024-11-14T08:57:11.921ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 246c15d9-f807-4711-aeea-96d95a3a4f96, dataset_name: DatasetName { pool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10672024-11-14T08:57:11.921ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 246c15d9-f807-4711-aeea-96d95a3a4f96, dataset_name: DatasetName { pool_name: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, kind: Crucible }, responder: ... }
10682024-11-14T08:57:11.972ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 990412ff-f4f5-45ab-985c-d9f6540d957f, dataset_name: DatasetName { pool_name: ZpoolName { id: 6032d020-e97f-4442-878e-bcdbe3293876 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10692024-11-14T08:57:11.972ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 990412ff-f4f5-45ab-985c-d9f6540d957f, dataset_name: DatasetName { pool_name: ZpoolName { id: 6032d020-e97f-4442-878e-bcdbe3293876 (zpool), kind: External }, kind: Crucible }, responder: ... }
10702024-11-14T08:57:12.018ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1e1dc082-3cc7-4b01-9b4d-6665f49367f1, dataset_name: DatasetName { pool_name: ZpoolName { id: 8a4b1a2c-0585-4f12-8c9a-b7cf61af774a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10712024-11-14T08:57:12.018ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1e1dc082-3cc7-4b01-9b4d-6665f49367f1, dataset_name: DatasetName { pool_name: ZpoolName { id: 8a4b1a2c-0585-4f12-8c9a-b7cf61af774a (zpool), kind: External }, kind: Crucible }, responder: ... }
10722024-11-14T08:57:12.069ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fea12524-8ceb-44e9-ad92-7e4bbea8d7d7, dataset_name: DatasetName { pool_name: ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10732024-11-14T08:57:12.069ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: fea12524-8ceb-44e9-ad92-7e4bbea8d7d7, dataset_name: DatasetName { pool_name: ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }, kind: Crucible }, responder: ... }
10742024-11-14T08:57:12.115ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57, dataset_name: DatasetName { pool_name: ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10752024-11-14T08:57:12.115ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57, dataset_name: DatasetName { pool_name: ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External }, kind: Crucible }, responder: ... }
10762024-11-14T08:57:12.176ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10772024-11-14T08:57:12.176ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/omicron-zones.json file = common/src/ledger.rs:177
10782024-11-14T08:57:12.176ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/omicron-zones.json file = common/src/ledger.rs:177
10792024-11-14T08:57:12.176ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10802024-11-14T08:57:12.336ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10812024-11-14T08:57:12.336ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10822024-11-14T08:57:12.336ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10832024-11-14T08:57:12.336ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10842024-11-14T08:57:12.363ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10852024-11-14T08:57:12.363ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10862024-11-14T08:57:12.363ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10872024-11-14T08:57:12.363ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10882024-11-14T08:57:12.363ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10892024-11-14T08:57:12.365ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10902024-11-14T08:57:12.517ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10912024-11-14T08:57:12.517ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10922024-11-14T08:57:12.580ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10932024-11-14T08:57:12.580ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10942024-11-14T08:57:12.580ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10952024-11-14T08:57:12.580ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10962024-11-14T08:57:12.580ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10972024-11-14T08:57:12.580ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10982024-11-14T08:57:12.592ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10992024-11-14T08:57:12.592ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96 file = illumos-utils/src/zone.rs:325
11002024-11-14T08:57:12.597ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1 file = illumos-utils/src/zone.rs:325
11012024-11-14T08:57:12.602ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7 file = illumos-utils/src/zone.rs:325
11022024-11-14T08:57:12.608ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57 file = illumos-utils/src/zone.rs:325
11032024-11-14T08:57:12.613ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932 file = illumos-utils/src/zone.rs:325
11042024-11-14T08:57:12.619ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39 file = illumos-utils/src/zone.rs:325
11052024-11-14T08:57:12.624ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f file = illumos-utils/src/zone.rs:325
11062024-11-14T08:57:12.778ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96 file = illumos-utils/src/zone.rs:363
11072024-11-14T08:57:12.786ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1 file = illumos-utils/src/zone.rs:363
11082024-11-14T08:57:12.792ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7 file = illumos-utils/src/zone.rs:363
11092024-11-14T08:57:12.797ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57 file = illumos-utils/src/zone.rs:363
11102024-11-14T08:57:12.802ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932 file = illumos-utils/src/zone.rs:363
11112024-11-14T08:57:12.806ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39 file = illumos-utils/src/zone.rs:363
11122024-11-14T08:57:12.811ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f file = illumos-utils/src/zone.rs:363
11132024-11-14T08:57:12.816ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612 file = illumos-utils/src/zone.rs:325
11142024-11-14T08:57:12.822ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459 file = illumos-utils/src/zone.rs:325
11152024-11-14T08:57:12.827ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf file = illumos-utils/src/zone.rs:325
11162024-11-14T08:57:12.832ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a file = illumos-utils/src/zone.rs:325
11172024-11-14T08:57:12.838ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7 file = illumos-utils/src/zone.rs:325
11182024-11-14T08:57:12.844ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da file = illumos-utils/src/zone.rs:325
11192024-11-14T08:57:12.849ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a file = illumos-utils/src/zone.rs:325
11202024-11-14T08:57:12.855ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612 file = illumos-utils/src/zone.rs:363
11212024-11-14T08:57:12.861ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459 file = illumos-utils/src/zone.rs:363
11222024-11-14T08:57:12.867ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf file = illumos-utils/src/zone.rs:363
11232024-11-14T08:57:12.874ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a file = illumos-utils/src/zone.rs:363
11242024-11-14T08:57:12.881ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7 file = illumos-utils/src/zone.rs:363
11252024-11-14T08:57:12.891ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da file = illumos-utils/src/zone.rs:363
11262024-11-14T08:57:12.900ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a file = illumos-utils/src/zone.rs:363
11272024-11-14T08:57:12.967ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11282024-11-14T08:57:13.025ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11292024-11-14T08:57:13.084ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11302024-11-14T08:57:13.141ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11312024-11-14T08:57:13.197ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11322024-11-14T08:57:13.199ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11332024-11-14T08:57:13.199ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11342024-11-14T08:57:13.254ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 140, 97]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11352024-11-14T08:57:13.255ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11362024-11-14T08:57:13.257ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11372024-11-14T08:57:13.257ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11382024-11-14T08:57:13.310ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 167, 168]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11392024-11-14T08:57:13.311ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11402024-11-14T08:57:13.312ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11412024-11-14T08:57:13.312ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11422024-11-14T08:57:13.369ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 134, 0]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11432024-11-14T08:57:13.369ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11442024-11-14T08:57:13.371ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11452024-11-14T08:57:13.371ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11462024-11-14T08:57:13.426ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 195, 209]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11472024-11-14T08:57:13.426ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11482024-11-14T08:57:13.428ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11492024-11-14T08:57:13.428ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11502024-11-14T08:57:13.482ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 231, 49]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11512024-11-14T08:57:13.482ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11522024-11-14T08:57:13.485ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
11532024-11-14T08:57:13.485ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
11542024-11-14T08:57:13.485ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
11552024-11-14T08:57:13.485ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
11562024-11-14T08:57:13.485ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
11572024-11-14T08:57:13.485ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
11582024-11-14T08:57:13.485ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
11592024-11-14T08:57:13.485ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
11602024-11-14T08:57:13.485ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
11612024-11-14T08:57:13.485ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
11622024-11-14T08:57:13.495ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
11632024-11-14T08:57:13.497ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11642024-11-14T08:57:13.497ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
11652024-11-14T08:57:13.499ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
11662024-11-14T08:57:13.503ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11672024-11-14T08:57:13.503ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11682024-11-14T08:57:13.546ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
11692024-11-14T08:57:13.552ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
11702024-11-14T08:57:13.558ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11712024-11-14T08:57:13.558ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11722024-11-14T08:57:13.634ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335 file = illumos-utils/src/zone.rs:325
11732024-11-14T08:57:13.751ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0 file = illumos-utils/src/zone.rs:325
11742024-11-14T08:57:13.771ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104 file = illumos-utils/src/zone.rs:325
11752024-11-14T08:57:13.788ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335 file = illumos-utils/src/zone.rs:363
11762024-11-14T08:57:13.815ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b file = illumos-utils/src/zone.rs:325
11772024-11-14T08:57:13.838ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8 file = illumos-utils/src/zone.rs:325
11782024-11-14T08:57:13.875ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0 file = illumos-utils/src/zone.rs:363
11792024-11-14T08:57:13.895ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104 file = illumos-utils/src/zone.rs:363
11802024-11-14T08:57:13.934ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b file = illumos-utils/src/zone.rs:363
11812024-11-14T08:57:13.945ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8 file = illumos-utils/src/zone.rs:363
11822024-11-14T08:57:15.886ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11832024-11-14T08:57:15.888ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
11842024-11-14T08:57:16.269ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_adf8829f-c3eb-4450-b693-c7220506810c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7f0fb445-6bb2-4c1e-aec2-6e69a2a9954e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11852024-11-14T08:57:16.270ZINFOSledAgent (ServiceManager): Booting oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
11862024-11-14T08:57:16.286ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8a4b1a2c-0585-4f12-8c9a-b7cf61af774a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='23554b4a-e353-436c-9444-d2d6326c7be6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11872024-11-14T08:57:16.297ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_6032d020-e97f-4442-878e-bcdbe3293876/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0602b67f-b0f6-494e-84d6-6c11b44bcde0'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11882024-11-14T08:57:16.297ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7d1e429d-74f9-4a0f-9382-4b993f07db56/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c5240a68-1dbc-4e67-b38a-7c373e245d44'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11892024-11-14T08:57:16.297ZINFOSledAgent (ServiceManager): Booting oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
11902024-11-14T08:57:16.301ZINFOSledAgent (ServiceManager): Booting oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
11912024-11-14T08:57:16.315ZINFOSledAgent (ServiceManager): Booting oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
11922024-11-14T08:57:16.392ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_493c27e1-df39-477b-8315-ad9aa5767668/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='49c3ced6-5e9d-4906-8ccf-f7f4f5a6c3da'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11932024-11-14T08:57:16.394ZINFOSledAgent (ServiceManager): Booting oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
11942024-11-14T08:57:16.439ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11952024-11-14T08:57:16.453ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
11962024-11-14T08:57:16.458ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ef6848de-2e18-4d49-825f-a08523c761f3/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='8bd2ee41-4f7c-4497-a18d-84364dc0cd6e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11972024-11-14T08:57:16.458ZINFOSledAgent (ServiceManager): Booting oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
11982024-11-14T08:57:16.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 48.102533ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
11992024-11-14T08:57:16.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 83.909361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
12002024-11-14T08:57:16.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 28.621123ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
12012024-11-14T08:57:16.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 69.25254ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
12022024-11-14T08:57:16.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 59.05912ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
12032024-11-14T08:57:16.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 47.529959ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
12042024-11-14T08:57:16.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 133.246947ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
12052024-11-14T08:57:16.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 149.918228ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
12062024-11-14T08:57:16.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 46.389495ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
12072024-11-14T08:57:16.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 58.77569ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
12082024-11-14T08:57:16.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 97.752503ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
12092024-11-14T08:57:16.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 129.332475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
12102024-11-14T08:57:16.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 42.822966ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
12112024-11-14T08:57:16.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 30.275838ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
12122024-11-14T08:57:17.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 231.21233ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
12132024-11-14T08:57:17.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 288.124669ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
12142024-11-14T08:57:17.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 273.705383ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
12152024-11-14T08:57:17.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 65.191079ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
12162024-11-14T08:57:17.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 299.365084ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
12172024-11-14T08:57:17.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 99.297344ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
12182024-11-14T08:57:17.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 184.339716ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
12192024-11-14T08:57:17.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 81.519074ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
12202024-11-14T08:57:17.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 150.714261ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
12212024-11-14T08:57:17.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 287.997281ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
12222024-11-14T08:57:17.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 200.090045ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
12232024-11-14T08:57:17.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 177.134461ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
12242024-11-14T08:57:17.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 234.301671ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
12252024-11-14T08:57:17.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 578.574086ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
12262024-11-14T08:57:17.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 562.245998ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
12272024-11-14T08:57:17.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 563.122223ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
12282024-11-14T08:57:17.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 230.560685ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
12292024-11-14T08:57:17.467ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_371f3005-927c-4e65-88a0-18072469758d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='210b3b51-b126-430a-a77c-2978ede63d33'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12302024-11-14T08:57:17.467ZINFOSledAgent (ServiceManager): Booting oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
12312024-11-14T08:57:17.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 592.890855ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
12322024-11-14T08:57:17.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 515.133792ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
12332024-11-14T08:57:17.518ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12342024-11-14T08:57:17.518ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
12352024-11-14T08:57:17.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 599.094088ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
12362024-11-14T08:57:17.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 1.181602283s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
12372024-11-14T08:57:17.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 496.012039ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
12382024-11-14T08:57:17.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 47.788148ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
12392024-11-14T08:57:17.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 32.007021ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
12402024-11-14T08:57:17.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 69.9305ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
12412024-11-14T08:57:17.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 61.008355ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
12422024-11-14T08:57:17.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 188.805261ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
12432024-11-14T08:57:17.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 166.824224ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
12442024-11-14T08:57:17.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 1.032929625s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
12452024-11-14T08:57:17.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 918.078267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
12462024-11-14T08:57:18.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 717.610972ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
12472024-11-14T08:57:18.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 505.346229ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
12482024-11-14T08:57:18.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 414.43124ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
12492024-11-14T08:57:18.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 206.32904ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
12502024-11-14T08:57:18.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 1.15934973s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
12512024-11-14T08:57:18.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 1.218014949s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
12522024-11-14T08:57:18.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 1.240059296s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
12532024-11-14T08:57:18.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 420.134379ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
12542024-11-14T08:57:18.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 1.042465264s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
12552024-11-14T08:57:18.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 669.604498ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
12562024-11-14T08:57:18.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 970.354699ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
12572024-11-14T08:57:18.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 1.338630442s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
12582024-11-14T08:57:18.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 1.272018515s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
12592024-11-14T08:57:18.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 872.097025ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
12602024-11-14T08:57:19.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 576.022404ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
12612024-11-14T08:57:19.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 1.336876877s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
12622024-11-14T08:57:19.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 696.348914ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
12632024-11-14T08:57:19.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 1.409594565s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
12642024-11-14T08:57:19.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 1.489888456s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
12652024-11-14T08:57:19.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 716.783944ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
12662024-11-14T08:57:19.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 748.66262ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
12672024-11-14T08:57:19.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 1.385427567s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
12682024-11-14T08:57:19.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 1.39486152s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
12692024-11-14T08:57:20.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 686.535466ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
12702024-11-14T08:57:20.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 605.604119ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
12712024-11-14T08:57:20.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 1.087780452s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
12722024-11-14T08:57:20.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 1.228861994s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
12732024-11-14T08:57:20.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 911.243865ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
12742024-11-14T08:57:20.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 1.103702508s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
12752024-11-14T08:57:20.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 974.38657ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
12762024-11-14T08:57:20.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 660.468271ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
12772024-11-14T08:57:20.871ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d752d0db-efe8-492a-8a25-a56ee29e644b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d3984aab-12fb-4309-b3ea-f7e661d78f96'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12782024-11-14T08:57:20.920ZINFOSledAgent (ServiceManager): Booting oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
12792024-11-14T08:57:20.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 804.43568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
12802024-11-14T08:57:21.025ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12812024-11-14T08:57:21.060ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
12822024-11-14T08:57:21.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 649.197121ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
12832024-11-14T08:57:21.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 1.183768081s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
12842024-11-14T08:57:21.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 67.383835ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
12852024-11-14T08:57:21.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 729.350816ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
12862024-11-14T08:57:21.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 75.396552ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
12872024-11-14T08:57:21.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 699.887257ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
12882024-11-14T08:57:21.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 73.096166ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
12892024-11-14T08:57:21.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 119.234555ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
12902024-11-14T08:57:21.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 1.206556399s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
12912024-11-14T08:57:21.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 121.320478ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
12922024-11-14T08:57:21.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 361.134575ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
12932024-11-14T08:57:21.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 667.84239ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
12942024-11-14T08:57:21.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 294.147187ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
12952024-11-14T08:57:21.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 1.027209479s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
12962024-11-14T08:57:21.618ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='487ff140-60d3-41ba-8767-caa53806d612'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12972024-11-14T08:57:21.660ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
12982024-11-14T08:57:21.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 685.0775ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
12992024-11-14T08:57:21.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 1.437124596s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
13002024-11-14T08:57:21.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 868.6469ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
13012024-11-14T08:57:21.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 272.502282ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
13022024-11-14T08:57:21.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 1.450825623s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
13032024-11-14T08:57:21.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 897.117689ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
13042024-11-14T08:57:21.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 60.330304ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
13052024-11-14T08:57:21.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 1.411770138s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
13062024-11-14T08:57:22.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 1.499074017s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
13072024-11-14T08:57:22.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 62.306104ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
13082024-11-14T08:57:22.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 106.330252ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
13092024-11-14T08:57:22.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 1.087502738s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
13102024-11-14T08:57:22.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 992.636477ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
13112024-11-14T08:57:22.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 378.17664ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
13122024-11-14T08:57:22.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 1.173474977s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
13132024-11-14T08:57:22.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 1.278257201s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
13142024-11-14T08:57:22.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 1.300080071s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
13152024-11-14T08:57:22.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 736.290821ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
13162024-11-14T08:57:22.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 1.38205029s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
13172024-11-14T08:57:22.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 692.826653ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
13182024-11-14T08:57:22.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 833.979109ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
13192024-11-14T08:57:22.937ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41273
13202024-11-14T08:57:23.039ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102407 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41273 req_id = 101940ec-3226-4cdb-be4e-eb1c38b9dacb response_code = 200 uri = /baseboard
13212024-11-14T08:57:23.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 845.738727ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
13222024-11-14T08:57:23.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 877.73828ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
13232024-11-14T08:57:23.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 1.013893858s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
13242024-11-14T08:57:23.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 701.078795ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
13252024-11-14T08:57:23.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 1.211698566s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
13262024-11-14T08:57:23.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 622.317504ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
13272024-11-14T08:57:23.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 812.008451ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
13282024-11-14T08:57:23.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 1.358355652s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
13292024-11-14T08:57:23.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 1.45210859s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
13302024-11-14T08:57:23.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 932.720079ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
13312024-11-14T08:57:23.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 774.708767ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
13322024-11-14T08:57:23.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 624.81257ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
13332024-11-14T08:57:24.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 548.011883ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
13342024-11-14T08:57:24.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 740.997123ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
13352024-11-14T08:57:24.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 623.985851ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
13362024-11-14T08:57:24.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 543.898087ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
13372024-11-14T08:57:24.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 1.362338923s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
13382024-11-14T08:57:24.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 1.25259411s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
13392024-11-14T08:57:24.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 916.384811ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
13402024-11-14T08:57:24.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 1.369126797s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
13412024-11-14T08:57:24.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 1.002541144s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
13422024-11-14T08:57:24.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 1.43297945s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
13432024-11-14T08:57:24.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 1.144852808s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
13442024-11-14T08:57:24.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 1.357409677s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
13452024-11-14T08:57:24.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 527.161105ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
13462024-11-14T08:57:24.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 675.493198ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
13472024-11-14T08:57:24.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 680.916571ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
13482024-11-14T08:57:24.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 1.195720014s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
13492024-11-14T08:57:24.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 1.278335256s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
13502024-11-14T08:57:25.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 705.359271ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
13512024-11-14T08:57:25.138ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.458477166s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
13522024-11-14T08:57:25.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 776.820299ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
13532024-11-14T08:57:25.187ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='be552e9b-d406-4152-9a59-f1431b7502a3'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13542024-11-14T08:57:25.188ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
13552024-11-14T08:57:25.216ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13562024-11-14T08:57:25.217ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
13572024-11-14T08:57:25.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 1.128367698s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
13582024-11-14T08:57:25.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 63.579826ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
13592024-11-14T08:57:25.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 40.317909ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
13602024-11-14T08:57:25.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 1.295703058s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
13612024-11-14T08:57:25.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 1.47246978s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
13622024-11-14T08:57:25.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 1.157973974s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
13632024-11-14T08:57:25.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 119.212227ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
13642024-11-14T08:57:25.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 79.478287ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
13652024-11-14T08:57:25.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 628.471706ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
13662024-11-14T08:57:25.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 289.194672ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
13672024-11-14T08:57:25.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 122.39539ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
13682024-11-14T08:57:25.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 690.474387ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
13692024-11-14T08:57:25.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 482.5343ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
13702024-11-14T08:57:25.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 617.832697ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
13712024-11-14T08:57:25.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 1.311773728s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
13722024-11-14T08:57:25.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 388.000155ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
13732024-11-14T08:57:25.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 888.669659ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
13742024-11-14T08:57:25.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 665.954661ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
13752024-11-14T08:57:26.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 1.283526503s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
13762024-11-14T08:57:26.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 983.358607ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
13772024-11-14T08:57:26.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 1.309310712s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
13782024-11-14T08:57:26.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 1.269214348s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
13792024-11-14T08:57:26.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 575.892575ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
13802024-11-14T08:57:26.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 705.126762ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
13812024-11-14T08:57:26.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 1.07990667s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
13822024-11-14T08:57:26.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 1.264944654s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
13832024-11-14T08:57:26.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 1.280011326s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
13842024-11-14T08:57:26.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 740.656233ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
13852024-11-14T08:57:26.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 959.818183ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
13862024-11-14T08:57:26.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 1.027382779s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
13872024-11-14T08:57:26.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 719.607822ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
13882024-11-14T08:57:26.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 503.22949ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
13892024-11-14T08:57:26.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 847.418812ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
13902024-11-14T08:57:27.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 734.311786ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
13912024-11-14T08:57:27.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 673.022283ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
13922024-11-14T08:57:27.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 553.962894ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
13932024-11-14T08:57:27.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 647.858605ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
13942024-11-14T08:57:27.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 1.265248984s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
13952024-11-14T08:57:27.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 741.951635ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
13962024-11-14T08:57:27.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 940.16593ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
13972024-11-14T08:57:27.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 756.914129ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
13982024-11-14T08:57:27.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 617.530723ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
13992024-11-14T08:57:27.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 1.142497788s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
14002024-11-14T08:57:27.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 924.88952ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
14012024-11-14T08:57:27.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 1.371483272s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
14022024-11-14T08:57:27.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 854.980594ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
14032024-11-14T08:57:27.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 976.959397ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
14042024-11-14T08:57:27.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 505.204809ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
14052024-11-14T08:57:27.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 876.988454ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
14062024-11-14T08:57:27.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 574.745193ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
14072024-11-14T08:57:27.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 1.036858875s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
14082024-11-14T08:57:27.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 1.336835922s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
14092024-11-14T08:57:28.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 714.931715ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
14102024-11-14T08:57:28.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 1.422366596s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
14112024-11-14T08:57:28.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 504.410836ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
14122024-11-14T08:57:28.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 1.001456985s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
14132024-11-14T08:57:28.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 1.13481129s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
14142024-11-14T08:57:28.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 1.055144692s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
14152024-11-14T08:57:28.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 534.007807ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
14162024-11-14T08:57:28.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 1.219323687s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
14172024-11-14T08:57:28.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 945.748371ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
14182024-11-14T08:57:28.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 1.464223028s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
14192024-11-14T08:57:28.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 826.299534ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
14202024-11-14T08:57:28.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 1.158497237s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
14212024-11-14T08:57:28.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 531.982228ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
14222024-11-14T08:57:28.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 1.273345205s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
14232024-11-14T08:57:28.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 922.542034ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
14242024-11-14T08:57:29.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 1.191805504s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
14252024-11-14T08:57:29.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 684.07406ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
14262024-11-14T08:57:29.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 691.516336ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
14272024-11-14T08:57:29.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 994.321049ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
14282024-11-14T08:57:29.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 829.858412ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
14292024-11-14T08:57:29.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 778.699888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
14302024-11-14T08:57:29.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 630.717373ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
14312024-11-14T08:57:29.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 937.640603ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
14322024-11-14T08:57:29.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 605.797472ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
14332024-11-14T08:57:29.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 552.638667ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
14342024-11-14T08:57:29.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 1.494781863s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
14352024-11-14T08:57:29.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 843.171335ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
14362024-11-14T08:57:29.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 736.480211ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
14372024-11-14T08:57:29.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 703.314282ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
14382024-11-14T08:57:30.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 1.21608975s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
14392024-11-14T08:57:30.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 1.459033903s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
14402024-11-14T08:57:30.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 1.359612076s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
14412024-11-14T08:57:30.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 549.1693ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
14422024-11-14T08:57:30.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 533.405242ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
14432024-11-14T08:57:30.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 503.215306ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
14442024-11-14T08:57:30.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 1.282735847s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
14452024-11-14T08:57:30.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 995.46358ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
14462024-11-14T08:57:30.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 902.462657ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
14472024-11-14T08:57:30.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 824.076016ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
14482024-11-14T08:57:30.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 638.293916ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
14492024-11-14T08:57:30.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 972.145292ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
14502024-11-14T08:57:30.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 622.964045ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
14512024-11-14T08:57:30.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 1.273724237s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
14522024-11-14T08:57:30.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 1.234490684s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
14532024-11-14T08:57:30.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 949.997647ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
14542024-11-14T08:57:30.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 1.111618701s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
14552024-11-14T08:57:31.006ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14562024-11-14T08:57:31.051ZINFOSledAgent (ServiceManager): Booting oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
14572024-11-14T08:57:31.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 1.392611086s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
14582024-11-14T08:57:31.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 1.035132922s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
14592024-11-14T08:57:31.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 733.918483ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
14602024-11-14T08:57:31.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 1.010474434s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
14612024-11-14T08:57:31.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 661.146592ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
14622024-11-14T08:57:31.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 524.706487ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
14632024-11-14T08:57:31.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 649.335485ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
14642024-11-14T08:57:31.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 60.07233ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
14652024-11-14T08:57:31.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 101.385558ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
14662024-11-14T08:57:31.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 861.077516ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
14672024-11-14T08:57:31.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 1.315609129s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
14682024-11-14T08:57:31.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 1.116109453s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
14692024-11-14T08:57:31.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 127.955524ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
14702024-11-14T08:57:31.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 1.301971695s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
14712024-11-14T08:57:31.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 658.942197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
14722024-11-14T08:57:31.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 280.565858ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
14732024-11-14T08:57:31.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 793.023501ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
14742024-11-14T08:57:31.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 739.896387ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
14752024-11-14T08:57:31.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 1.420028989s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
14762024-11-14T08:57:31.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 1.251211753s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
14772024-11-14T08:57:31.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 1.243296027s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
14782024-11-14T08:57:32.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 1.189307743s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
14792024-11-14T08:57:32.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 858.658906ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
14802024-11-14T08:57:32.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 981.473499ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
14812024-11-14T08:57:32.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 758.776063ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
14822024-11-14T08:57:32.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 1.222578029s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
14832024-11-14T08:57:32.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 1.250967625s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
14842024-11-14T08:57:32.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 730.899415ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
14852024-11-14T08:57:32.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 1.184092448s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
14862024-11-14T08:57:32.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 1.235445086s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
14872024-11-14T08:57:32.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 1.415093961s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
14882024-11-14T08:57:32.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 1.429346289s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
14892024-11-14T08:57:32.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 1.437629828s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
14902024-11-14T08:57:32.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 979.466972ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
14912024-11-14T08:57:32.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 1.353941211s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
14922024-11-14T08:57:33.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 829.372676ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
14932024-11-14T08:57:33.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 525.323159ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
14942024-11-14T08:57:33.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 514.986954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
14952024-11-14T08:57:33.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 1.330155494s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
14962024-11-14T08:57:33.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 1.103157587s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
14972024-11-14T08:57:33.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 1.305523469s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
14982024-11-14T08:57:33.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 1.021163251s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
14992024-11-14T08:57:33.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 1.287128498s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
15002024-11-14T08:57:33.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 1.12632275s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
15012024-11-14T08:57:33.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 814.847497ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
15022024-11-14T08:57:33.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 1.11608053s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
15032024-11-14T08:57:33.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 1.17311254s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
15042024-11-14T08:57:33.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 643.777898ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
15052024-11-14T08:57:33.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 1.489605732s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
15062024-11-14T08:57:33.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 1.144296768s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
15072024-11-14T08:57:34.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 639.949752ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
15082024-11-14T08:57:34.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 632.311156ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
15092024-11-14T08:57:34.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 996.040191ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
15102024-11-14T08:57:34.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 1.028186719s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
15112024-11-14T08:57:34.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 532.435266ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
15122024-11-14T08:57:34.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 740.445667ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
15132024-11-14T08:57:34.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 834.866277ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
15142024-11-14T08:57:34.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 983.022286ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
15152024-11-14T08:57:34.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 555.83121ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
15162024-11-14T08:57:34.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 582.980197ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
15172024-11-14T08:57:34.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 1.019222156s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
15182024-11-14T08:57:34.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 593.799004ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
15192024-11-14T08:57:34.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 1.264067716s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
15202024-11-14T08:57:34.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 892.008797ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
15212024-11-14T08:57:34.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 867.733116ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
15222024-11-14T08:57:34.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 1.06368358s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
15232024-11-14T08:57:35.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 1.069017854s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
15242024-11-14T08:57:35.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 1.373189231s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
15252024-11-14T08:57:35.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 569.406932ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
15262024-11-14T08:57:35.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 550.068493ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
15272024-11-14T08:57:35.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 1.406615611s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
15282024-11-14T08:57:35.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 922.249247ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
15292024-11-14T08:57:35.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 535.889004ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
15302024-11-14T08:57:35.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 1.03159584s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
15312024-11-14T08:57:35.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 1.027549019s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
15322024-11-14T08:57:35.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 821.451663ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
15332024-11-14T08:57:35.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 1.046830758s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
15342024-11-14T08:57:35.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 1.021175687s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
15352024-11-14T08:57:35.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 1.011476506s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
15362024-11-14T08:57:35.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 987.4179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
15372024-11-14T08:57:35.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 825.017347ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
15382024-11-14T08:57:35.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 1.495572266s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
15392024-11-14T08:57:35.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 910.463783ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
15402024-11-14T08:57:35.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 851.31053ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
15412024-11-14T08:57:36.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 599.573121ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
15422024-11-14T08:57:36.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 1.23809631s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
15432024-11-14T08:57:36.104ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15442024-11-14T08:57:36.104ZINFOSledAgent (ServiceManager): Booting oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
15452024-11-14T08:57:36.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 712.545846ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
15462024-11-14T08:57:36.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 1.224829824s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
15472024-11-14T08:57:36.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104") failed: Property not found. retry in 31.942245ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
15482024-11-14T08:57:36.304ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15492024-11-14T08:57:36.304ZINFOSledAgent (ServiceManager): Booting oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335
15502024-11-14T08:57:36.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104") failed: Property not found. retry in 61.342605ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
15512024-11-14T08:57:36.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104") failed: Property not found. retry in 104.596766ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
15522024-11-14T08:57:36.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 827.340379ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
15532024-11-14T08:57:36.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 1.128454253s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
15542024-11-14T08:57:36.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 817.160758ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
15552024-11-14T08:57:36.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335") failed: Property not found. retry in 74.680249ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335
15562024-11-14T08:57:36.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104") failed: Property not found. retry in 202.211657ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
15572024-11-14T08:57:36.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 1.178071887s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
15582024-11-14T08:57:36.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 1.277878868s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
15592024-11-14T08:57:36.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335") failed: Property not found. retry in 85.324364ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335
15602024-11-14T08:57:36.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 734.452137ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
15612024-11-14T08:57:36.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335") failed: Property not found. retry in 186.753903ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335
15622024-11-14T08:57:36.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 884.868616ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
15632024-11-14T08:57:36.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 505.468585ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
15642024-11-14T08:57:36.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104") failed: Property not found. retry in 553.465114ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
15652024-11-14T08:57:36.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 673.224794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
15662024-11-14T08:57:36.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 1.16686157s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
15672024-11-14T08:57:36.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 1.383639547s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
15682024-11-14T08:57:36.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 1.449296041s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
15692024-11-14T08:57:36.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335") failed: Property not found. retry in 483.418587ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335
15702024-11-14T08:57:36.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 500.591261ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
15712024-11-14T08:57:37.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 574.044515ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
15722024-11-14T08:57:37.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 563.127695ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
15732024-11-14T08:57:37.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 609.423152ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
15742024-11-14T08:57:37.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 1.359584182s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
15752024-11-14T08:57:37.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104") failed: Property not found. retry in 1.291974994s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
15762024-11-14T08:57:37.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 882.78631ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
15772024-11-14T08:57:37.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 949.282542ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
15782024-11-14T08:57:37.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335") failed: Property not found. retry in 937.252882ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335
15792024-11-14T08:57:37.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 1.251190114s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
15802024-11-14T08:57:37.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 1.110796189s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
15812024-11-14T08:57:37.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 1.130589119s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
15822024-11-14T08:57:37.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 863.121083ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
15832024-11-14T08:57:37.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 573.093925ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
15842024-11-14T08:57:37.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 1.276202995s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
15852024-11-14T08:57:37.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 799.785353ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
15862024-11-14T08:57:37.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 803.202941ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
15872024-11-14T08:57:37.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 864.757895ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
15882024-11-14T08:57:37.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 783.532003ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
15892024-11-14T08:57:37.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 712.606605ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
15902024-11-14T08:57:38.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 1.418489779s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
15912024-11-14T08:57:38.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 843.788157ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
15922024-11-14T08:57:38.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 1.406755296s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
15932024-11-14T08:57:38.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 839.060617ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
15942024-11-14T08:57:38.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 1.385972035s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
15952024-11-14T08:57:38.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335") failed: Property not found. retry in 1.484758543s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335
15962024-11-14T08:57:38.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 1.393575201s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
15972024-11-14T08:57:38.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 612.901147ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
15982024-11-14T08:57:38.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104") failed: Property not found. retry in 561.830469ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
15992024-11-14T08:57:38.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 1.28532328s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
16002024-11-14T08:57:38.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 1.038590216s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
16012024-11-14T08:57:38.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 1.143448931s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
16022024-11-14T08:57:38.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 1.30013917s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
16032024-11-14T08:57:38.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 819.106356ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
16042024-11-14T08:57:38.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 1.494000248s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
16052024-11-14T08:57:38.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 1.304075341s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
16062024-11-14T08:57:38.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 1.447323718s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
16072024-11-14T08:57:39.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 1.120678754s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
16082024-11-14T08:57:39.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 902.001991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
16092024-11-14T08:57:39.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 1.154755648s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
16102024-11-14T08:57:39.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104") failed: Property not found. retry in 531.295795ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
16112024-11-14T08:57:39.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 1.098472711s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
16122024-11-14T08:57:39.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 1.084667023s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
16132024-11-14T08:57:39.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 750.671226ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
16142024-11-14T08:57:39.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 876.63239ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
16152024-11-14T08:57:39.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 1.439947979s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
16162024-11-14T08:57:39.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 544.784273ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
16172024-11-14T08:57:39.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104") failed: Property not found. retry in 657.047929ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
16182024-11-14T08:57:39.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 1.08781877s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
16192024-11-14T08:57:39.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335") failed: Property not found. retry in 1.415241637s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335
16202024-11-14T08:57:39.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 821.437178ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
16212024-11-14T08:57:39.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 1.042579134s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
16222024-11-14T08:57:39.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 1.412016055s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
16232024-11-14T08:57:39.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 1.241991497s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
16242024-11-14T08:57:40.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 1.03026606s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
16252024-11-14T08:57:40.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 514.032677ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
16262024-11-14T08:57:40.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 1.098298262s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
16272024-11-14T08:57:40.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 572.037435ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
16282024-11-14T08:57:40.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 1.166638177s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
16292024-11-14T08:57:40.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 1.288870859s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
16302024-11-14T08:57:40.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 534.855279ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
16312024-11-14T08:57:40.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 1.377982445s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
16322024-11-14T08:57:40.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104") failed: Property not found. retry in 963.635049ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
16332024-11-14T08:57:40.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 1.383642806s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
16342024-11-14T08:57:40.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 823.896896ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
16352024-11-14T08:57:40.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 532.377258ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
16362024-11-14T08:57:40.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 1.032808842s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
16372024-11-14T08:57:40.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 1.48477914s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
16382024-11-14T08:57:40.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 1.452003069s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
16392024-11-14T08:57:40.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 979.420084ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
16402024-11-14T08:57:40.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 676.451014ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
16412024-11-14T08:57:41.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 754.031503ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
16422024-11-14T08:57:41.122ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16432024-11-14T08:57:41.122ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459
16442024-11-14T08:57:41.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 1.251332389s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
16452024-11-14T08:57:41.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 978.021584ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
16462024-11-14T08:57:41.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 547.626483ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
16472024-11-14T08:57:41.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335") failed: Property not found. retry in 1.041951434s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335
16482024-11-14T08:57:41.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459") failed: Property not found. retry in 31.533343ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459
16492024-11-14T08:57:41.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 949.730019ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
16502024-11-14T08:57:41.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459") failed: Property not found. retry in 101.794865ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459
16512024-11-14T08:57:41.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104") failed: Property not found. retry in 563.308714ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
16522024-11-14T08:57:41.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 688.651492ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
16532024-11-14T08:57:41.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 1.290773611s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
16542024-11-14T08:57:41.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 860.559922ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
16552024-11-14T08:57:41.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459") failed: Property not found. retry in 248.067011ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459
16562024-11-14T08:57:41.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 1.006859622s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
16572024-11-14T08:57:41.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 1.479662396s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
16582024-11-14T08:57:41.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459") failed: Property not found. retry in 271.665675ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459
16592024-11-14T08:57:41.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 954.827737ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
16602024-11-14T08:57:41.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 1.027267365s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
16612024-11-14T08:57:41.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 805.470899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
16622024-11-14T08:57:41.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 1.459739984s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
16632024-11-14T08:57:41.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 860.069348ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
16642024-11-14T08:57:41.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104") failed: Property not found. retry in 610.30664ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
16652024-11-14T08:57:41.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 1.161939366s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
16662024-11-14T08:57:41.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459") failed: Property not found. retry in 1.094676069s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459
16672024-11-14T08:57:42.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 1.400694394s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
16682024-11-14T08:57:42.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 1.070897927s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
16692024-11-14T08:57:42.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 779.707328ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
16702024-11-14T08:57:42.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 770.821586ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
16712024-11-14T08:57:42.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335") failed: Property not found. retry in 1.131316143s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335
16722024-11-14T08:57:42.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 589.904604ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
16732024-11-14T08:57:42.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 1.268930652s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
16742024-11-14T08:57:42.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 1.334182437s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
16752024-11-14T08:57:42.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104") failed: Property not found. retry in 943.964412ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
16762024-11-14T08:57:42.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 584.644436ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
16772024-11-14T08:57:42.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 595.836857ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
16782024-11-14T08:57:42.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 1.415805319s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
16792024-11-14T08:57:42.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 929.799264ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
16802024-11-14T08:57:42.755ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.408424566s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
16812024-11-14T08:57:42.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 953.822579ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
16822024-11-14T08:57:42.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 939.473454ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
16832024-11-14T08:57:42.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 1.17837826s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
16842024-11-14T08:57:43.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 640.610928ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
16852024-11-14T08:57:43.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 1.196154416s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
16862024-11-14T08:57:43.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459") failed: Property not found. retry in 964.620864ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459
16872024-11-14T08:57:43.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 549.483183ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
16882024-11-14T08:57:43.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 809.719362ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
16892024-11-14T08:57:43.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 867.69936ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
16902024-11-14T08:57:43.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 953.967355ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
16912024-11-14T08:57:43.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 1.064269677s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
16922024-11-14T08:57:43.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 901.5445ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
16932024-11-14T08:57:43.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335") failed: Property not found. retry in 887.487317ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335
16942024-11-14T08:57:43.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 720.759009ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
16952024-11-14T08:57:43.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104") failed: Property not found. retry in 863.43578ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
16962024-11-14T08:57:43.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 1.470300684s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
16972024-11-14T08:57:43.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 705.827837ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
16982024-11-14T08:57:43.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 1.261350067s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
16992024-11-14T08:57:43.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 1.046119754s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
17002024-11-14T08:57:43.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 748.350179ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
17012024-11-14T08:57:43.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 652.916163ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
17022024-11-14T08:57:43.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 623.609873ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
17032024-11-14T08:57:43.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 1.000536114s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
17042024-11-14T08:57:44.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459") failed: Property not found. retry in 734.482703ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459
17052024-11-14T08:57:44.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 919.42712ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
17062024-11-14T08:57:44.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 1.056412398s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
17072024-11-14T08:57:44.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 548.732632ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
17082024-11-14T08:57:44.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 1.134596467s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
17092024-11-14T08:57:44.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 902.556777ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
17102024-11-14T08:57:44.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 1.437259365s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
17112024-11-14T08:57:44.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 660.608464ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
17122024-11-14T08:57:44.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335") failed: Property not found. retry in 945.49018ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335
17132024-11-14T08:57:44.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 944.633809ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
17142024-11-14T08:57:44.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104") failed: Property not found. retry in 848.708982ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
17152024-11-14T08:57:44.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 779.630971ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
17162024-11-14T08:57:44.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 955.104034ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
17172024-11-14T08:57:44.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 1.081964335s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
17182024-11-14T08:57:44.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 1.112966626s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
17192024-11-14T08:57:44.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 1.22071998s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
17202024-11-14T08:57:44.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 1.047046304s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
17212024-11-14T08:57:44.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459") failed: Property not found. retry in 521.746612ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459
17222024-11-14T08:57:44.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 1.23847317s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
17232024-11-14T08:57:44.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 696.762102ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
17242024-11-14T08:57:44.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 698.116582ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
17252024-11-14T08:57:45.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 643.61034ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
17262024-11-14T08:57:45.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 1.121244027s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
17272024-11-14T08:57:45.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 1.265276741s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
17282024-11-14T08:57:45.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 1.287639347s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
17292024-11-14T08:57:45.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 861.547511ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
17302024-11-14T08:57:45.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104") failed: Property not found. retry in 1.258223217s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
17312024-11-14T08:57:45.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335") failed: Property not found. retry in 852.325656ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335
17322024-11-14T08:57:45.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 942.053773ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
17332024-11-14T08:57:45.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 541.771099ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
17342024-11-14T08:57:45.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459") failed: Property not found. retry in 990.316551ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459
17352024-11-14T08:57:45.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 1.34380784s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
17362024-11-14T08:57:45.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 1.133199603s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
17372024-11-14T08:57:45.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 805.644109ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
17382024-11-14T08:57:45.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 610.409992ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
17392024-11-14T08:57:45.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 669.927886ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
17402024-11-14T08:57:45.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 830.729386ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
17412024-11-14T08:57:45.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 981.141064ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
17422024-11-14T08:57:45.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 1.345647305s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
17432024-11-14T08:57:45.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 1.243417066s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
17442024-11-14T08:57:45.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 1.015565661s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
17452024-11-14T08:57:46.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 619.029389ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
17462024-11-14T08:57:46.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335") failed: Property not found. retry in 1.465894342s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335
17472024-11-14T08:57:46.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 685.586454ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
17482024-11-14T08:57:46.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 1.330493866s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
17492024-11-14T08:57:46.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 704.193125ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
17502024-11-14T08:57:46.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 1.185584307s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
17512024-11-14T08:57:46.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459") failed: Property not found. retry in 730.774793ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459
17522024-11-14T08:57:46.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 972.202071ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
17532024-11-14T08:57:46.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 1.231723368s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
17542024-11-14T08:57:46.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 1.367247651s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
17552024-11-14T08:57:46.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 1.390643891s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
17562024-11-14T08:57:46.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104") failed: Property not found. retry in 1.478330195s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
17572024-11-14T08:57:46.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 1.383167986s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
17582024-11-14T08:57:46.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 684.755326ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
17592024-11-14T08:57:46.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 1.216598412s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
17602024-11-14T08:57:46.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 1.38933862s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
17612024-11-14T08:57:46.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 635.253504ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
17622024-11-14T08:57:46.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 1.234362557s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
17632024-11-14T08:57:46.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 1.471277823s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
17642024-11-14T08:57:47.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 1.033761691s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
17652024-11-14T08:57:47.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459") failed: Property not found. retry in 539.521798ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459
17662024-11-14T08:57:47.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 1.291669446s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
17672024-11-14T08:57:47.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 1.233865498s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
17682024-11-14T08:57:47.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 817.125273ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
17692024-11-14T08:57:47.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 668.034353ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
17702024-11-14T08:57:47.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 1.027187083s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
17712024-11-14T08:57:47.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 1.009256898s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
17722024-11-14T08:57:47.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 934.712357ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
17732024-11-14T08:57:47.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335") failed: Property not found. retry in 930.397975ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335
17742024-11-14T08:57:47.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 737.060201ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
17752024-11-14T08:57:47.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459") failed: Property not found. retry in 1.417467056s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459
17762024-11-14T08:57:47.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 1.106292944s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
17772024-11-14T08:57:47.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 1.126613768s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
17782024-11-14T08:57:47.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 984.027599ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
17792024-11-14T08:57:47.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 816.119493ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
17802024-11-14T08:57:48.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104") failed: Property not found. retry in 885.489638ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
17812024-11-14T08:57:48.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 1.183892293s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
17822024-11-14T08:57:48.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 871.773652ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
17832024-11-14T08:57:48.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 1.156354694s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
17842024-11-14T08:57:48.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 870.260099ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
17852024-11-14T08:57:48.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 1.392098214s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
17862024-11-14T08:57:48.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 752.025351ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
17872024-11-14T08:57:48.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 854.076328ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
17882024-11-14T08:57:48.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 1.062676244s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
17892024-11-14T08:57:48.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 1.218451472s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
17902024-11-14T08:57:48.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 845.628706ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
17912024-11-14T08:57:48.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 1.293965288s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
17922024-11-14T08:57:48.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 1.251514754s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
17932024-11-14T08:57:48.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335") failed: Property not found. retry in 573.160016ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335
17942024-11-14T08:57:48.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 753.558313ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
17952024-11-14T08:57:48.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104") failed: Property not found. retry in 881.945566ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
17962024-11-14T08:57:48.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 1.386355228s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
17972024-11-14T08:57:48.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 644.321308ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
17982024-11-14T08:57:48.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 905.61894ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
17992024-11-14T08:57:49.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 1.283184367s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
18002024-11-14T08:57:49.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 754.135374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
18012024-11-14T08:57:49.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459") failed: Property not found. retry in 1.290029573s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459
18022024-11-14T08:57:49.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 1.387209417s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
18032024-11-14T08:57:49.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335") failed: Property not found. retry in 1.405831118s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335
18042024-11-14T08:57:49.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 615.850339ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
18052024-11-14T08:57:49.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 649.50221ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
18062024-11-14T08:57:49.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 1.380712208s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
18072024-11-14T08:57:49.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 1.397707801s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
18082024-11-14T08:57:49.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 1.138154554s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
18092024-11-14T08:57:49.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 1.318830878s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
18102024-11-14T08:57:49.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 1.406230634s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
18112024-11-14T08:57:49.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 1.389619233s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
18122024-11-14T08:57:49.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 738.32789ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
18132024-11-14T08:57:49.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 1.350751803s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
18142024-11-14T08:57:49.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 795.871983ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
18152024-11-14T08:57:49.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104") failed: Property not found. retry in 1.426834622s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
18162024-11-14T08:57:49.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 687.551139ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
18172024-11-14T08:57:49.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 796.654438ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
18182024-11-14T08:57:49.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 1.123127396s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
18192024-11-14T08:57:49.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 816.881477ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
18202024-11-14T08:57:50.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 1.060196596s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
18212024-11-14T08:57:50.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 560.15723ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
18222024-11-14T08:57:50.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459") failed: Property not found. retry in 991.542125ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459
18232024-11-14T08:57:50.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 1.244987939s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
18242024-11-14T08:57:50.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 604.888136ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
18252024-11-14T08:57:50.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 1.211974565s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
18262024-11-14T08:57:50.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335") failed: Property not found. retry in 1.125236681s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335
18272024-11-14T08:57:50.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39") failed: Property not found. retry in 1.39320783s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
18282024-11-14T08:57:50.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 846.342325ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
18292024-11-14T08:57:50.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 1.347503581s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
18302024-11-14T08:57:50.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 1.04070154s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
18312024-11-14T08:57:50.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 925.129303ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
18322024-11-14T08:57:50.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 773.447081ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
18332024-11-14T08:57:50.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 1.47500472s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
18342024-11-14T08:57:50.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 1.135780908s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
18352024-11-14T08:57:51.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 740.535694ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
18362024-11-14T08:57:51.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 1.345332921s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
18372024-11-14T08:57:51.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 750.628855ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
18382024-11-14T08:57:51.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 943.92384ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
18392024-11-14T08:57:51.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 1.132342372s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
18402024-11-14T08:57:51.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104") failed: Property not found. retry in 871.231907ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
18412024-11-14T08:57:51.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 1.374309257s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
18422024-11-14T08:57:51.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459") failed: Property not found. retry in 529.16834ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459
18432024-11-14T08:57:51.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7") failed: Property not found. retry in 960.81386ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
18442024-11-14T08:57:51.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 563.937235ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
18452024-11-14T08:57:51.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 500.516144ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
18462024-11-14T08:57:51.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 1.278435363s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
18472024-11-14T08:57:51.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 1.023645532s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
18482024-11-14T08:57:51.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335") failed: Property not found. retry in 1.453868076s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335
18492024-11-14T08:57:51.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 1.165165023s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
18502024-11-14T08:57:51.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612") failed: Property not found. retry in 842.964161ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
18512024-11-14T08:57:51.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 920.556683ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
18522024-11-14T08:57:51.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459") failed: Property not found. retry in 764.915628ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459
18532024-11-14T08:57:52.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96") failed: Property not found. retry in 1.323578148s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
18542024-11-14T08:57:52.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1") failed: Property not found. retry in 957.160081ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
18552024-11-14T08:57:52.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a") failed: Property not found. retry in 1.178346494s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
18562024-11-14T08:57:52.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 1.06106556s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
18572024-11-14T08:57:52.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104") failed: Property not found. retry in 1.231644879s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
18582024-11-14T08:57:52.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf") failed: Property not found. retry in 1.197736391s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
18592024-11-14T08:57:52.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a") failed: Property not found. retry in 1.313316944s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
18602024-11-14T08:57:52.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f") failed: Property not found. retry in 1.429329332s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
18612024-11-14T08:57:52.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b") failed: Property not found. retry in 1.451595657s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
18622024-11-14T08:57:52.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459") failed: Property not found. retry in 771.401045ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459
18632024-11-14T08:57:52.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7") failed: Property not found. retry in 666.318156ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
18642024-11-14T08:57:52.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0") failed: Property not found. retry in 1.269772423s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
18652024-11-14T08:57:52.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da") failed: Property not found. retry in 1.17320146s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
18662024-11-14T08:57:52.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932") failed: Property not found. retry in 761.062481ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
18672024-11-14T08:57:52.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57") failed: Property not found. retry in 1.033865156s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
18682024-11-14T08:57:53.076ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57642
18692024-11-14T08:57:53.078ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1252 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57642 req_id = 98b9783c-c21f-4025-84a1-6df14b0171a4 response_code = 200 uri = /baseboard
18702024-11-14T08:57:53.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8") failed: Property not found. retry in 657.486536ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
18712024-11-14T08:57:54.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_246c15d9-f807-4711-aeea-96d95a3a4f96
18722024-11-14T08:57:54.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_1e1dc082-3cc7-4b01-9b4d-6665f49367f1
18732024-11-14T08:57:54.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_fea12524-8ceb-44e9-ad92-7e4bbea8d7d7
18742024-11-14T08:57:54.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_d3dd4036-6839-48d6-8f36-e642d9b3e6c0
18752024-11-14T08:57:54.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_d7d5db2e-c7e4-4c3e-a430-60e6f88c8b57
18762024-11-14T08:57:54.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_6482a797-acc5-4429-a69d-994bb976d932
18772024-11-14T08:57:54.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_e0a01057-219f-41cb-a79d-4a4fe7ac4b39
18782024-11-14T08:57:54.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_990412ff-f4f5-45ab-985c-d9f6540d957f
18792024-11-14T08:57:54.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_484a1c50-302f-49ec-9214-2179c2ff7104
18802024-11-14T08:57:54.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_b933d23e-28f4-4f5e-9ad9-9694702ed335
18812024-11-14T08:57:54.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_487ff140-60d3-41ba-8767-caa53806d612
18822024-11-14T08:57:54.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_ef32bdd5-939a-4ab0-a70a-6f004e97691b
18832024-11-14T08:57:54.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_2a6883f8-ec62-4596-8432-b355f1bcf459
18842024-11-14T08:57:54.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_4b55850d-21aa-4517-8f88-047ba02d9bbf
18852024-11-14T08:57:54.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_de8d096d-77dd-4078-8cf4-d9c4c50a402a
18862024-11-14T08:57:54.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_583b4ecb-2b33-44c9-9d2e-0a024470bae7
18872024-11-14T08:57:54.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_37b94fe2-7e49-4f8b-ab73-391d62dac7da
18882024-11-14T08:57:54.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_e0fbd02e-9643-47c5-9261-dd03abc268a8
18892024-11-14T08:57:54.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_fb28afbb-471d-45de-9b44-66acd21dfe6a
18902024-11-14T08:57:54.064ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18912024-11-14T08:57:54.068ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18922024-11-14T08:57:54.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42898861 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:56192 req_id = f3ba5174-c9b7-41e1-b1e5-708bfbeb8d90 response_code = 204 uri = /omicron-zones
18932024-11-14T08:57:54.080ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1448
18942024-11-14T08:57:54.083ZINFOSledAgent (RSS): Writing ledger to /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18952024-11-14T08:57:54.083ZINFOSledAgent (RSS): Writing ledger to /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18962024-11-14T08:57:54.138ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:787
18972024-11-14T08:57:54.146ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::c]:12221 file = sled-agent/src/rack_setup/service.rs:799
18982024-11-14T08:57:54.207ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1013
18992024-11-14T08:57:58.051ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/f4ca1ebb-1dae-4dba-966b-c23460ac15fd/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
19002024-11-14T08:57:58.055ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 18.893543476s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
19012024-11-14T08:57:58.111ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/f4ca1ebb-1dae-4dba-966b-c23460ac15fd/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
19022024-11-14T08:57:58.288ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/f4ca1ebb-1dae-4dba-966b-c23460ac15fd/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
19032024-11-14T08:57:58.471ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/f4ca1ebb-1dae-4dba-966b-c23460ac15fd/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
19042024-11-14T08:57:58.650ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/f4ca1ebb-1dae-4dba-966b-c23460ac15fd/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
19052024-11-14T08:57:58.946ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/f4ca1ebb-1dae-4dba-966b-c23460ac15fd/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
19062024-11-14T08:57:59.138ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/f4ca1ebb-1dae-4dba-966b-c23460ac15fd/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
19072024-11-14T08:57:59.296ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/f4ca1ebb-1dae-4dba-966b-c23460ac15fd/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
19082024-11-14T08:57:59.733ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/f4ca1ebb-1dae-4dba-966b-c23460ac15fd/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
19092024-11-14T08:58:00.078ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/f4ca1ebb-1dae-4dba-966b-c23460ac15fd/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
19102024-11-14T08:58:00.395ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/f4ca1ebb-1dae-4dba-966b-c23460ac15fd/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
19112024-11-14T08:58:00.781ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/f4ca1ebb-1dae-4dba-966b-c23460ac15fd/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
19122024-11-14T08:58:01.575ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/f4ca1ebb-1dae-4dba-966b-c23460ac15fd/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
19132024-11-14T08:58:02.360ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/f4ca1ebb-1dae-4dba-966b-c23460ac15fd/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
19142024-11-14T08:58:03.978ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "533efd20-5f67-47ed-a2a9-8d120dd9383f", "content-length": "173", "date": "Thu, 14 Nov 2024 08:58:03 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"f4ca1ebb-1dae-4dba-966b-c23460ac15fd\"", request_id: "533efd20-5f67-47ed-a2a9-8d120dd9383f" } file = sled-agent/src/rack_setup/service.rs:1075
19152024-11-14T08:58:04.674ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c9cc3899-502a-4c49-bbd0-a9f6ce8307e7", "content-length": "173", "date": "Thu, 14 Nov 2024 08:58:03 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"f4ca1ebb-1dae-4dba-966b-c23460ac15fd\"", request_id: "c9cc3899-502a-4c49-bbd0-a9f6ce8307e7" } file = sled-agent/src/rack_setup/service.rs:1075
19162024-11-14T08:58:07.622ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b3d96a22-9e35-4abe-a7ea-db7c9caf6930", "content-length": "173", "date": "Thu, 14 Nov 2024 08:58:06 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"65d2236a-3110-4d84-aa25-77e21779db87\"", request_id: "b3d96a22-9e35-4abe-a7ea-db7c9caf6930" } file = sled-agent/src/rack_setup/service.rs:1075
19172024-11-14T08:58:09.193ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c8313194-2491-4500-9360-aa11ceb4f929", "content-length": "173", "date": "Thu, 14 Nov 2024 08:58:08 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"65d2236a-3110-4d84-aa25-77e21779db87\"", request_id: "c8313194-2491-4500-9360-aa11ceb4f929" } file = sled-agent/src/rack_setup/service.rs:1075
19182024-11-14T08:58:11.126ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d1126189-873f-45d5-9dcf-07b3e2c3f1ab", "content-length": "173", "date": "Thu, 14 Nov 2024 08:58:11 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"65d2236a-3110-4d84-aa25-77e21779db87\"", request_id: "d1126189-873f-45d5-9dcf-07b3e2c3f1ab" } file = sled-agent/src/rack_setup/service.rs:1075
19192024-11-14T08:58:14.817ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "fb45c766-acaf-4012-87ad-b4bceb3c0552", "content-length": "173", "date": "Thu, 14 Nov 2024 08:58:14 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"65d2236a-3110-4d84-aa25-77e21779db87\"", request_id: "fb45c766-acaf-4012-87ad-b4bceb3c0552" } file = sled-agent/src/rack_setup/service.rs:1075
19202024-11-14T08:58:18.396ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
19212024-11-14T08:58:18.489ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40034
19222024-11-14T08:58:18.493ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19232024-11-14T08:58:18.494ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19242024-11-14T08:58:18.495ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/omicron-zones.json file = common/src/ledger.rs:177
19252024-11-14T08:58:18.503ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/omicron-zones.json file = common/src/ledger.rs:177
19262024-11-14T08:58:18.517ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19272024-11-14T08:58:18.517ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_371f3005-927c-4e65-88a0-18072469758d
19282024-11-14T08:58:18.547ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19292024-11-14T08:58:18.547ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_adf8829f-c3eb-4450-b693-c7220506810c
19302024-11-14T08:58:18.572ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19312024-11-14T08:58:18.572ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7d1e429d-74f9-4a0f-9382-4b993f07db56
19322024-11-14T08:58:18.595ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19332024-11-14T08:58:18.596ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_493c27e1-df39-477b-8315-ad9aa5767668
19342024-11-14T08:58:18.617ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19352024-11-14T08:58:18.617ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ef6848de-2e18-4d49-825f-a08523c761f3
19362024-11-14T08:58:18.637ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6032d020-e97f-4442-878e-bcdbe3293876 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19372024-11-14T08:58:18.637ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_6032d020-e97f-4442-878e-bcdbe3293876
19382024-11-14T08:58:18.659ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8a4b1a2c-0585-4f12-8c9a-b7cf61af774a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19392024-11-14T08:58:18.659ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8a4b1a2c-0585-4f12-8c9a-b7cf61af774a
19402024-11-14T08:58:18.681ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19412024-11-14T08:58:18.681ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d752d0db-efe8-492a-8a25-a56ee29e644b
19422024-11-14T08:58:18.701ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19432024-11-14T08:58:18.701ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7
19442024-11-14T08:58:18.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223911 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40034 req_id = 97443bf1-8924-4954-9d0c-76dc23926e42 response_code = 200 uri = /inventory
19452024-11-14T08:58:19.165ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:48029 remote_addr = [fd00:1122:3344:101::d]:60592 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
19462024-11-14T08:58:19.202ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31372 local_addr = [fd00:1122:3344:101::1]:48029 method = GET remote_addr = [fd00:1122:3344:101::d]:60592 req_id = 8cfd2b34-ce52-4ec3-98a9-1764f1b6e4a1 response_code = 200 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 uri = /65d2236a-3110-4d84-aa25-77e21779db87
19472024-11-14T08:58:19.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47480
19482024-11-14T08:58:19.641ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 208292a9-20b7-485e-95b8-8fa301192abc, kind: Service { id: ef32bdd5-939a-4ab0-a70a-6f004e97691b }, name: Name("external-dns-ef32bdd5-939a-4ab0-a70a-6f004e97691b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 49])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7b6a42b1-a060-4782-a598-da956f0e54bf, kind: Service { id: e0fbd02e-9643-47c5-9261-dd03abc268a8 }, name: Name("external-dns-e0fbd02e-9643-47c5-9261-dd03abc268a8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3d08f9bf-1395-4918-83ef-e9bf23bb54cc, kind: Service { id: d3dd4036-6839-48d6-8f36-e642d9b3e6c0 }, name: Name("nexus-d3dd4036-6839-48d6-8f36-e642d9b3e6c0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 97])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eb09bf8b-0a0a-43d0-8fab-de971f1991ea, kind: Service { id: b933d23e-28f4-4f5e-9ad9-9694702ed335 }, name: Name("nexus-b933d23e-28f4-4f5e-9ad9-9694702ed335"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f73311b5-bba3-40b6-b24a-8c3229a71a49, kind: Service { id: 484a1c50-302f-49ec-9214-2179c2ff7104 }, name: Name("nexus-484a1c50-302f-49ec-9214-2179c2ff7104"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19492024-11-14T08:58:19.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19502024-11-14T08:58:19.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19512024-11-14T08:58:19.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19522024-11-14T08:58:19.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19532024-11-14T08:58:19.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19542024-11-14T08:58:19.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19552024-11-14T08:58:19.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10937 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47480 req_id = a4245403-0683-4927-a839-0a09833a4d3d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19562024-11-14T08:58:19.643ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1085
19572024-11-14T08:58:19.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60170
19582024-11-14T08:58:19.944ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19592024-11-14T08:58:19.944ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19602024-11-14T08:58:19.944ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/omicron-zones.json file = common/src/ledger.rs:177
19612024-11-14T08:58:19.944ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/omicron-zones.json file = common/src/ledger.rs:177
19622024-11-14T08:58:19.956ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19632024-11-14T08:58:19.956ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_371f3005-927c-4e65-88a0-18072469758d
19642024-11-14T08:58:19.980ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19652024-11-14T08:58:19.980ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_adf8829f-c3eb-4450-b693-c7220506810c
19662024-11-14T08:58:20.003ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19672024-11-14T08:58:20.003ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7d1e429d-74f9-4a0f-9382-4b993f07db56
19682024-11-14T08:58:20.027ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19692024-11-14T08:58:20.027ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_493c27e1-df39-477b-8315-ad9aa5767668
19702024-11-14T08:58:20.049ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19712024-11-14T08:58:20.049ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ef6848de-2e18-4d49-825f-a08523c761f3
19722024-11-14T08:58:20.071ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6032d020-e97f-4442-878e-bcdbe3293876 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19732024-11-14T08:58:20.071ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_6032d020-e97f-4442-878e-bcdbe3293876
19742024-11-14T08:58:20.092ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8a4b1a2c-0585-4f12-8c9a-b7cf61af774a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19752024-11-14T08:58:20.092ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8a4b1a2c-0585-4f12-8c9a-b7cf61af774a
19762024-11-14T08:58:20.112ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19772024-11-14T08:58:20.112ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d752d0db-efe8-492a-8a25-a56ee29e644b
19782024-11-14T08:58:20.134ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19792024-11-14T08:58:20.134ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7
19802024-11-14T08:58:20.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202864 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60170 req_id = 64c563db-f1db-48ec-a6aa-d8ec3515cb5c response_code = 200 uri = /inventory
19812024-11-14T08:58:20.951ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42738
19822024-11-14T08:58:20.951ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 208292a9-20b7-485e-95b8-8fa301192abc, kind: Service { id: ef32bdd5-939a-4ab0-a70a-6f004e97691b }, name: Name("external-dns-ef32bdd5-939a-4ab0-a70a-6f004e97691b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 49])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7b6a42b1-a060-4782-a598-da956f0e54bf, kind: Service { id: e0fbd02e-9643-47c5-9261-dd03abc268a8 }, name: Name("external-dns-e0fbd02e-9643-47c5-9261-dd03abc268a8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3d08f9bf-1395-4918-83ef-e9bf23bb54cc, kind: Service { id: d3dd4036-6839-48d6-8f36-e642d9b3e6c0 }, name: Name("nexus-d3dd4036-6839-48d6-8f36-e642d9b3e6c0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 97])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eb09bf8b-0a0a-43d0-8fab-de971f1991ea, kind: Service { id: b933d23e-28f4-4f5e-9ad9-9694702ed335 }, name: Name("nexus-b933d23e-28f4-4f5e-9ad9-9694702ed335"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f73311b5-bba3-40b6-b24a-8c3229a71a49, kind: Service { id: 484a1c50-302f-49ec-9214-2179c2ff7104 }, name: Name("nexus-484a1c50-302f-49ec-9214-2179c2ff7104"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19832024-11-14T08:58:20.951ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19842024-11-14T08:58:20.951ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19852024-11-14T08:58:20.951ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19862024-11-14T08:58:20.951ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19872024-11-14T08:58:20.951ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19882024-11-14T08:58:20.951ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19892024-11-14T08:58:20.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 330 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42738 req_id = 11eeb750-2986-4905-86b4-97d54536c437 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19902024-11-14T08:58:21.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52928
19912024-11-14T08:58:21.148ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 208292a9-20b7-485e-95b8-8fa301192abc, kind: Service { id: ef32bdd5-939a-4ab0-a70a-6f004e97691b }, name: Name("external-dns-ef32bdd5-939a-4ab0-a70a-6f004e97691b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 49])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7b6a42b1-a060-4782-a598-da956f0e54bf, kind: Service { id: e0fbd02e-9643-47c5-9261-dd03abc268a8 }, name: Name("external-dns-e0fbd02e-9643-47c5-9261-dd03abc268a8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3d08f9bf-1395-4918-83ef-e9bf23bb54cc, kind: Service { id: d3dd4036-6839-48d6-8f36-e642d9b3e6c0 }, name: Name("nexus-d3dd4036-6839-48d6-8f36-e642d9b3e6c0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 97])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eb09bf8b-0a0a-43d0-8fab-de971f1991ea, kind: Service { id: b933d23e-28f4-4f5e-9ad9-9694702ed335 }, name: Name("nexus-b933d23e-28f4-4f5e-9ad9-9694702ed335"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f73311b5-bba3-40b6-b24a-8c3229a71a49, kind: Service { id: 484a1c50-302f-49ec-9214-2179c2ff7104 }, name: Name("nexus-484a1c50-302f-49ec-9214-2179c2ff7104"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19922024-11-14T08:58:21.148ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19932024-11-14T08:58:21.148ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19942024-11-14T08:58:21.148ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19952024-11-14T08:58:21.148ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19962024-11-14T08:58:21.148ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19972024-11-14T08:58:21.148ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19982024-11-14T08:58:21.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52928 req_id = c16a786b-e083-4ecb-8076-bec74e81c36e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19992024-11-14T08:58:21.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39751
20002024-11-14T08:58:21.230ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 208292a9-20b7-485e-95b8-8fa301192abc, kind: Service { id: ef32bdd5-939a-4ab0-a70a-6f004e97691b }, name: Name("external-dns-ef32bdd5-939a-4ab0-a70a-6f004e97691b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 49])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7b6a42b1-a060-4782-a598-da956f0e54bf, kind: Service { id: e0fbd02e-9643-47c5-9261-dd03abc268a8 }, name: Name("external-dns-e0fbd02e-9643-47c5-9261-dd03abc268a8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3d08f9bf-1395-4918-83ef-e9bf23bb54cc, kind: Service { id: d3dd4036-6839-48d6-8f36-e642d9b3e6c0 }, name: Name("nexus-d3dd4036-6839-48d6-8f36-e642d9b3e6c0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 97])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eb09bf8b-0a0a-43d0-8fab-de971f1991ea, kind: Service { id: b933d23e-28f4-4f5e-9ad9-9694702ed335 }, name: Name("nexus-b933d23e-28f4-4f5e-9ad9-9694702ed335"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f73311b5-bba3-40b6-b24a-8c3229a71a49, kind: Service { id: 484a1c50-302f-49ec-9214-2179c2ff7104 }, name: Name("nexus-484a1c50-302f-49ec-9214-2179c2ff7104"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20012024-11-14T08:58:21.231ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20022024-11-14T08:58:21.231ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20032024-11-14T08:58:21.231ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20042024-11-14T08:58:21.231ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
20052024-11-14T08:58:21.231ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20062024-11-14T08:58:21.231ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20072024-11-14T08:58:21.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39751 req_id = cc1c9fba-d359-4550-9fbf-f6eb228f1526 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20082024-11-14T08:58:23.118ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50796
20092024-11-14T08:58:23.118ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50796 req_id = 92fa1799-b70b-451d-b027-a1a3eaeb835a response_code = 200 uri = /baseboard
20102024-11-14T08:58:25.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46502
20112024-11-14T08:58:25.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46502 req_id = 6fae18ff-535f-48ac-ae60-96478250be9a response_code = 200 uri = /vpc-routes
20122024-11-14T08:58:25.138ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
20132024-11-14T08:58:25.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2602 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46502 req_id = 3b8f1020-2c8d-4c8d-855e-344cb60535bf response_code = 204 uri = /eip-gateways
20142024-11-14T08:58:25.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5008 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46502 req_id = af910261-8f01-44ec-8260-138aee492e32 response_code = 204 uri = /vpc-routes
20152024-11-14T08:58:35.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37905
20162024-11-14T08:58:35.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37905 req_id = 61fc844c-6380-46e0-bfe2-bf009d04e05d response_code = 200 uri = /vpc-routes
20172024-11-14T08:58:35.471ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
20182024-11-14T08:58:35.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37905 req_id = ce84cb85-1e49-4ba5-8ef5-df6914619bcf response_code = 204 uri = /eip-gateways
20192024-11-14T08:58:35.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37905 req_id = a3815413-6ce9-419a-9b6f-e7a2831af1d3 response_code = 204 uri = /vpc-routes
20202024-11-14T08:58:35.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59401
20212024-11-14T08:58:35.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59401 req_id = 28d3c767-b8d9-41d0-8d5e-5fe1c5dbd2f7 response_code = 200 uri = /vpc-routes
20222024-11-14T08:58:35.640ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55072
20232024-11-14T08:58:35.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 482 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55072 req_id = 7cd21a11-8683-4e07-aace-382853c0c283 response_code = 200 uri = /v2p
20242024-11-14T08:58:35.660ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
20252024-11-14T08:58:35.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59401 req_id = 3dbd3b1f-f51a-4936-a30a-03fb08feaa94 response_code = 204 uri = /eip-gateways
20262024-11-14T08:58:35.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59401 req_id = 93456f26-4990-44ec-a9b6-ca1f268e51fa response_code = 204 uri = /vpc-routes
20272024-11-14T08:58:35.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40196
20282024-11-14T08:58:35.723ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20292024-11-14T08:58:35.813ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20302024-11-14T08:58:35.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155915 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40196 req_id = e42173aa-4be1-42bf-8650-bdde22c3f154 response_code = 204 uri = /switch-ports
20312024-11-14T08:58:35.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53603
20322024-11-14T08:58:35.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53745
20332024-11-14T08:58:35.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37921
20342024-11-14T08:58:35.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37921 req_id = 8cd6b87b-57d6-492b-af5b-fde5cb08eaf1 response_code = 200 uri = /v2p
20352024-11-14T08:58:35.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53745 req_id = fd5db678-7178-4a84-9eb7-a1fffa6b1768 response_code = 200 uri = /vpc-routes
20362024-11-14T08:58:35.878ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20372024-11-14T08:58:35.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9716 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40196 req_id = c1ebb9f7-0332-4c18-ab27-a7a476cdde9d response_code = 200 uri = /network-bootstore-config
20382024-11-14T08:58:35.893ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
20392024-11-14T08:58:35.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53745 req_id = 6b136b70-4601-4075-9c36-b71fda7b2673 response_code = 204 uri = /eip-gateways
20402024-11-14T08:58:35.936ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20412024-11-14T08:58:35.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61539
20422024-11-14T08:58:35.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 347 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61539 req_id = d4fe7b47-7cfe-4595-a764-6f36561c4017 response_code = 200 uri = /v2p
20432024-11-14T08:58:35.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 409 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53745 req_id = a5f709e3-5f01-4e10-adf7-cf7f8ecf5a8d response_code = 204 uri = /vpc-routes
20442024-11-14T08:58:35.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55833
20452024-11-14T08:58:35.999ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20462024-11-14T08:58:35.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120805 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53603 req_id = 85b7dfc9-8753-4d06-8e2f-fb38d756260c response_code = 204 uri = /switch-ports
20472024-11-14T08:58:36.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53603 req_id = b8b01e24-f9c7-4a54-a636-0de34c9ee155 response_code = 200 uri = /network-bootstore-config
20482024-11-14T08:58:36.021ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
20492024-11-14T08:58:36.022ZINFOSledAgent (bootstore): Writing ledger to /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
20502024-11-14T08:58:36.027ZINFOSledAgent (bootstore): Writing ledger to /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
20512024-11-14T08:58:36.028ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
20522024-11-14T08:58:36.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10796 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40196 req_id = c4cd298c-0693-4690-be61-4ff06307b05f response_code = 204 uri = /network-bootstore-config
20532024-11-14T08:58:36.035ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20542024-11-14T08:58:36.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105811 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55833 req_id = 46562851-c386-4289-aa30-94e132814d61 response_code = 204 uri = /switch-ports
20552024-11-14T08:58:36.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 516 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55833 req_id = df149e43-7420-4f7f-a73e-60a8d2844ff7 response_code = 200 uri = /network-bootstore-config
20562024-11-14T08:58:53.152ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44837
20572024-11-14T08:58:53.152ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44837 req_id = 92f2ad54-8550-48f2-a53d-3fcfad7470b0 response_code = 200 uri = /baseboard
20582024-11-14T08:59:05.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51667
20592024-11-14T08:59:05.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51667 req_id = 688808a1-9da6-40a6-8a56-ceacf1f7c8a3 response_code = 200 uri = /vpc-routes
20602024-11-14T08:59:05.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59298
20612024-11-14T08:59:05.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59298 req_id = 0bd274c7-f1df-4d4f-b616-a3e6d37cddee response_code = 200 uri = /vpc-routes
20622024-11-14T08:59:05.632ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
20632024-11-14T08:59:05.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51667 req_id = 26a804b8-19bf-443f-93a3-e15f9de3a70e response_code = 204 uri = /eip-gateways
20642024-11-14T08:59:05.729ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
20652024-11-14T08:59:05.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59298 req_id = 30291e16-86c6-4b1f-a93a-3e5e30493083 response_code = 204 uri = /eip-gateways
20662024-11-14T08:59:05.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 381 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59298 req_id = 9952ba84-a36f-416a-8130-3417e19b2b36 response_code = 204 uri = /vpc-routes
20672024-11-14T08:59:05.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40446
20682024-11-14T08:59:05.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40446 req_id = 90844044-9e01-44eb-a71d-f7774d5f84ab response_code = 200 uri = /v2p
20692024-11-14T08:59:05.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51667 req_id = 1d4a15ad-1e4d-4adc-a56e-8f5faa865bb7 response_code = 204 uri = /vpc-routes
20702024-11-14T08:59:05.833ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61099
20712024-11-14T08:59:05.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61099 req_id = 8cb96fdc-f337-4371-815f-1bb86fd8124c response_code = 200 uri = /v2p
20722024-11-14T08:59:05.848ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34262
20732024-11-14T08:59:05.848ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20742024-11-14T08:59:05.888ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20752024-11-14T08:59:05.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107244 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34262 req_id = a20b593b-e5ea-4efc-b2f8-70b154b9e298 response_code = 204 uri = /switch-ports
20762024-11-14T08:59:05.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62932
20772024-11-14T08:59:05.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34262 req_id = 36c77e11-8ef5-40f4-bfdb-8ab4fdb76f1c response_code = 200 uri = /network-bootstore-config
20782024-11-14T08:59:05.955ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20792024-11-14T08:59:05.992ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20802024-11-14T08:59:06.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34206
20812024-11-14T08:59:06.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34206 req_id = d26f85fa-8e25-41cb-b9ce-67fdbaf4bb7d response_code = 200 uri = /vpc-routes
20822024-11-14T08:59:06.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101952 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62932 req_id = 2b701743-271b-4bea-ae0f-725f88f05a46 response_code = 204 uri = /switch-ports
20832024-11-14T08:59:06.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62932 req_id = da3eba40-9d3a-4309-a37e-7ed08ed59628 response_code = 200 uri = /network-bootstore-config
20842024-11-14T08:59:06.078ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
20852024-11-14T08:59:06.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34206 req_id = 53cf35db-6911-4f1f-a0bf-f01e19ad64d9 response_code = 204 uri = /eip-gateways
20862024-11-14T08:59:06.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34206 req_id = 55357c4d-8130-4aff-9439-e02860614109 response_code = 204 uri = /vpc-routes
20872024-11-14T08:59:06.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51686
20882024-11-14T08:59:06.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51686 req_id = 01e39733-099d-49b4-9c83-ae45ed54cdaa response_code = 200 uri = /v2p
20892024-11-14T08:59:06.237ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43195
20902024-11-14T08:59:06.238ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20912024-11-14T08:59:06.293ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20922024-11-14T08:59:06.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140257 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43195 req_id = 42d3bec0-41f1-42d0-8e3f-fe9f44fe16c8 response_code = 204 uri = /switch-ports
20932024-11-14T08:59:06.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43195 req_id = be126ce0-4e7a-455e-b13d-86bd54106eee response_code = 200 uri = /network-bootstore-config
20942024-11-14T08:59:23.186ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60547
20952024-11-14T08:59:23.186ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60547 req_id = 652fdbfc-48ef-4de2-95a1-13d17dca54b4 response_code = 200 uri = /baseboard
20962024-11-14T08:59:35.405ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56409
20972024-11-14T08:59:35.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56409 req_id = dc76d7ea-e5d7-4b06-81ae-cbfcaf5d9112 response_code = 200 uri = /vpc-routes
20982024-11-14T08:59:35.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45923
20992024-11-14T08:59:35.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45923 req_id = 78d47f79-28e6-4194-b7e3-906ee1e33b35 response_code = 200 uri = /v2p
21002024-11-14T08:59:35.510ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56006
21012024-11-14T08:59:35.510ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21022024-11-14T08:59:35.555ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21032024-11-14T08:59:35.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131653 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56006 req_id = 8aae2370-609c-4933-8d70-67a8332449b5 response_code = 204 uri = /switch-ports
21042024-11-14T08:59:35.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52612
21052024-11-14T08:59:35.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56808
21062024-11-14T08:59:35.642ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
21072024-11-14T08:59:35.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56409 req_id = 83def16e-b809-42de-8bb4-58a791789fe3 response_code = 204 uri = /eip-gateways
21082024-11-14T08:59:35.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56006 req_id = c872ecaf-67a1-4749-9113-4d6da9557140 response_code = 200 uri = /network-bootstore-config
21092024-11-14T08:59:35.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52612 req_id = eabf2e75-0ec6-4170-bc79-8e97e4570a77 response_code = 200 uri = /vpc-routes
21102024-11-14T08:59:35.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56808 req_id = d350d0f7-01ea-47aa-9b04-e070beaaac95 response_code = 200 uri = /v2p
21112024-11-14T08:59:35.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56409 req_id = 5a5cc421-78b5-412c-8573-201389b736fc response_code = 204 uri = /vpc-routes
21122024-11-14T08:59:35.660ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
21132024-11-14T08:59:35.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52612 req_id = 99c01e58-b73a-4783-913b-81ffef202eba response_code = 204 uri = /eip-gateways
21142024-11-14T08:59:35.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52612 req_id = 1506a793-57d9-4ebf-8604-12f3e191d37a response_code = 204 uri = /vpc-routes
21152024-11-14T08:59:35.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39817
21162024-11-14T08:59:35.744ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21172024-11-14T08:59:35.782ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21182024-11-14T08:59:35.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91737 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39817 req_id = d6b8d13b-1247-4475-b0c2-34c0c47ac883 response_code = 204 uri = /switch-ports
21192024-11-14T08:59:35.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62101
21202024-11-14T08:59:35.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44364
21212024-11-14T08:59:35.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44364 req_id = 030e2f7e-2ec9-455a-9a8f-b6d06a1bfa74 response_code = 200 uri = /v2p
21222024-11-14T08:59:35.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62101 req_id = 8eafa59c-f03d-4dfa-b88c-4569d1c6b7b8 response_code = 200 uri = /vpc-routes
21232024-11-14T08:59:35.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39817 req_id = a1e22baa-6aaa-41a2-bcd4-b54230ee1acc response_code = 200 uri = /network-bootstore-config
21242024-11-14T08:59:35.850ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
21252024-11-14T08:59:35.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62101 req_id = 39d60674-a5fb-4d92-a731-f47f0635f7c9 response_code = 204 uri = /eip-gateways
21262024-11-14T08:59:35.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62101 req_id = 4a75bba7-d482-44a7-84e9-94025fe5bab8 response_code = 204 uri = /vpc-routes
21272024-11-14T08:59:35.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48831
21282024-11-14T08:59:35.918ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21292024-11-14T08:59:35.954ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21302024-11-14T08:59:36.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90643 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48831 req_id = f7030c02-870c-4ff2-a08f-0ce1bf27e28f response_code = 204 uri = /switch-ports
21312024-11-14T08:59:36.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48831 req_id = 2553cefd-05e4-41c5-9104-de55af4b155b response_code = 200 uri = /network-bootstore-config
21322024-11-14T08:59:53.219ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36357
21332024-11-14T08:59:53.220ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36357 req_id = e5946ec9-fbd1-41bb-bd7c-3a9a871c31b2 response_code = 200 uri = /baseboard
21342024-11-14T09:00:05.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55825
21352024-11-14T09:00:05.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55825 req_id = 0155d954-8896-4bc0-b04d-58d43753aaca response_code = 200 uri = /v2p
21362024-11-14T09:00:05.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37119
21372024-11-14T09:00:05.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37119 req_id = 84f2d0f6-1dfa-44fe-8f40-5580a3750b05 response_code = 200 uri = /vpc-routes
21382024-11-14T09:00:05.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34277
21392024-11-14T09:00:05.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34277 req_id = b77b95ab-5b0c-457c-ac90-022c9de550be response_code = 200 uri = /vpc-routes
21402024-11-14T09:00:05.763ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36842
21412024-11-14T09:00:05.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36842 req_id = d70be2ff-934f-4866-ab0d-f2fe3fc9191a response_code = 200 uri = /vpc-routes
21422024-11-14T09:00:05.839ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
21432024-11-14T09:00:05.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34277 req_id = 9407bf52-235a-4ab5-b911-3c248cdbbc09 response_code = 204 uri = /eip-gateways
21442024-11-14T09:00:05.850ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
21452024-11-14T09:00:05.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36842 req_id = 993eb2a0-d152-44b1-9d2e-77a5521ddbed response_code = 204 uri = /eip-gateways
21462024-11-14T09:00:05.879ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
21472024-11-14T09:00:05.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37119 req_id = 3aa5a718-6c7e-481c-b4be-f122abcbbeb4 response_code = 204 uri = /eip-gateways
21482024-11-14T09:00:05.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60427
21492024-11-14T09:00:05.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60427 req_id = 2a997bf9-6853-4e6d-9b65-645c7c04c002 response_code = 200 uri = /v2p
21502024-11-14T09:00:05.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33960
21512024-11-14T09:00:05.919ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21522024-11-14T09:00:05.958ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21532024-11-14T09:00:06.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95805 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33960 req_id = a426f220-c8d5-4d9f-bda4-b1f9d47b528a response_code = 204 uri = /switch-ports
21542024-11-14T09:00:06.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46067
21552024-11-14T09:00:06.015ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21562024-11-14T09:00:06.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 444 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36842 req_id = f4217f19-b325-49ff-8918-86ee340e5563 response_code = 204 uri = /vpc-routes
21572024-11-14T09:00:06.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33960 req_id = 75c8b924-288e-489e-b599-2d9d94d75fc9 response_code = 200 uri = /network-bootstore-config
21582024-11-14T09:00:06.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5518 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34277 req_id = dd71e7ec-a3e7-4d9d-b580-6b8b72b92404 response_code = 204 uri = /vpc-routes
21592024-11-14T09:00:06.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 805 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37119 req_id = 9b06fda3-8c67-4d7d-a33a-adcbc235da19 response_code = 204 uri = /vpc-routes
21602024-11-14T09:00:06.054ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21612024-11-14T09:00:06.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34924
21622024-11-14T09:00:06.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34924 req_id = cb9a071e-96c7-45ba-a414-16236b6ee059 response_code = 200 uri = /v2p
21632024-11-14T09:00:06.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92873 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46067 req_id = f6460d57-b22f-4ba0-bfd9-f773be5cf6fe response_code = 204 uri = /switch-ports
21642024-11-14T09:00:06.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46067 req_id = 31883b1a-9787-4769-a0ae-93858f108f6b response_code = 200 uri = /network-bootstore-config
21652024-11-14T09:00:06.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43913
21662024-11-14T09:00:06.240ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21672024-11-14T09:00:06.277ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21682024-11-14T09:00:06.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92008 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43913 req_id = b88cb15f-92d6-4570-b378-7666454ce538 response_code = 204 uri = /switch-ports
21692024-11-14T09:00:06.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43913 req_id = 8981e947-480e-4e69-ba3a-de94563eec9e response_code = 200 uri = /network-bootstore-config
21702024-11-14T09:00:23.251ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44008
21712024-11-14T09:00:23.251ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44008 req_id = 2b5ab268-5067-4a2d-a56f-c6b2df6f94b8 response_code = 200 uri = /baseboard
21722024-11-14T09:00:35.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55790
21732024-11-14T09:00:35.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55790 req_id = 7f7fd70d-1dd6-4196-a98a-884b2103488d response_code = 200 uri = /vpc-routes
21742024-11-14T09:00:35.488ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
21752024-11-14T09:00:35.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55790 req_id = 6c244238-862a-4e8b-b1e1-0004ec7a3c98 response_code = 204 uri = /eip-gateways
21762024-11-14T09:00:35.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56328
21772024-11-14T09:00:35.519ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21782024-11-14T09:00:35.570ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21792024-11-14T09:00:35.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123125 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56328 req_id = c3fc8f5a-1947-4e84-b7db-7c91bc7e5061 response_code = 204 uri = /switch-ports
21802024-11-14T09:00:35.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51010
21812024-11-14T09:00:35.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62569
21822024-11-14T09:00:35.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51010 req_id = af1f51b2-3660-4671-84b5-2c18c03d7e37 response_code = 200 uri = /v2p
21832024-11-14T09:00:35.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56328 req_id = c428c6ce-cecb-41f5-8537-e5017c42f664 response_code = 200 uri = /network-bootstore-config
21842024-11-14T09:00:35.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 500 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55790 req_id = 5e81ee70-e68e-4180-949a-736388172786 response_code = 204 uri = /vpc-routes
21852024-11-14T09:00:35.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62569 req_id = acef3ace-abf5-4603-ab5d-eebe634cf76d response_code = 200 uri = /vpc-routes
21862024-11-14T09:00:35.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40638
21872024-11-14T09:00:35.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40638 req_id = 16cdbbe5-248e-4174-8a12-86c3d33c86e4 response_code = 200 uri = /vpc-routes
21882024-11-14T09:00:35.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57640
21892024-11-14T09:00:35.683ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21902024-11-14T09:00:35.729ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21912024-11-14T09:00:35.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106314 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57640 req_id = fe26249f-7799-4544-8d52-0abcc4453d6a response_code = 204 uri = /switch-ports
21922024-11-14T09:00:35.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40179
21932024-11-14T09:00:35.789ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
21942024-11-14T09:00:35.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62569 req_id = c348f471-6282-4cb6-9df1-834579304e93 response_code = 204 uri = /eip-gateways
21952024-11-14T09:00:35.790ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
21962024-11-14T09:00:35.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40638 req_id = e28d98c9-a560-4ae9-af47-0f035b9a9093 response_code = 204 uri = /eip-gateways
21972024-11-14T09:00:35.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57640 req_id = e8bd6ae6-df2d-44d6-be54-7b3f2163cb78 response_code = 200 uri = /network-bootstore-config
21982024-11-14T09:00:35.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40179 req_id = d19ed53c-1753-4995-b7a5-df1152ca5ad1 response_code = 200 uri = /v2p
21992024-11-14T09:00:35.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33537
22002024-11-14T09:00:35.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33537 req_id = 5773ebae-9e97-4185-8f30-ace231df232a response_code = 200 uri = /v2p
22012024-11-14T09:00:35.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39176
22022024-11-14T09:00:35.895ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22032024-11-14T09:00:35.931ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22042024-11-14T09:00:35.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90467 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39176 req_id = 5c7267c2-f9b1-4ac2-94f2-16c01af0726a response_code = 204 uri = /switch-ports
22052024-11-14T09:00:35.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62569 req_id = 065eae1f-b027-4eb2-9e56-f7af84803a59 response_code = 204 uri = /vpc-routes
22062024-11-14T09:00:35.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39176 req_id = 25ceedbf-f10b-41ef-950f-5bfe967a0097 response_code = 200 uri = /network-bootstore-config
22072024-11-14T09:00:36.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 381 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40638 req_id = 0bae8c7e-5126-41f8-af91-7172bfe536d6 response_code = 204 uri = /vpc-routes
22082024-11-14T09:00:44.852ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
22092024-11-14T09:00:53.287ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50785
22102024-11-14T09:00:53.287ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50785 req_id = 5b584bfa-1cf8-4579-a759-900550f3d9d4 response_code = 200 uri = /baseboard
22112024-11-14T09:01:05.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52836
22122024-11-14T09:01:05.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52836 req_id = 26b78665-aacb-45db-ac10-b2665f52a1e0 response_code = 200 uri = /vpc-routes
22132024-11-14T09:01:05.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52595
22142024-11-14T09:01:05.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52595 req_id = 21a1dbfb-e9c0-4a53-a601-f57824927c4f response_code = 200 uri = /vpc-routes
22152024-11-14T09:01:05.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47382
22162024-11-14T09:01:05.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47382 req_id = 8a723025-fe7e-4fe4-8a7a-340a2aa2641c response_code = 200 uri = /v2p
22172024-11-14T09:01:05.793ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
22182024-11-14T09:01:05.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52836 req_id = cd6d5ee7-20b1-443e-ab19-0403a6bc8a17 response_code = 204 uri = /eip-gateways
22192024-11-14T09:01:05.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36831
22202024-11-14T09:01:05.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36831 req_id = 5648fe01-7871-481a-b705-18725d8bc895 response_code = 200 uri = /v2p
22212024-11-14T09:01:05.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52836 req_id = 32b0da1d-23d2-4198-b2f7-0a41936390c8 response_code = 204 uri = /vpc-routes
22222024-11-14T09:01:05.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50951
22232024-11-14T09:01:05.813ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22242024-11-14T09:01:05.854ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22252024-11-14T09:01:05.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111100 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50951 req_id = c590f9e5-829b-4515-99b8-4b3b6c7652f9 response_code = 204 uri = /switch-ports
22262024-11-14T09:01:05.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44247
22272024-11-14T09:01:05.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36037
22282024-11-14T09:01:05.924ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
22292024-11-14T09:01:05.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52595 req_id = cd3d0210-f578-4034-a0c4-8ceb0cea3a6a response_code = 204 uri = /eip-gateways
22302024-11-14T09:01:05.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36037 req_id = b0901f6b-f512-41d5-a48c-c522d3683c3b response_code = 200 uri = /vpc-routes
22312024-11-14T09:01:05.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50951 req_id = 33cc8bd5-e748-448a-8f15-a594021e94b9 response_code = 200 uri = /network-bootstore-config
22322024-11-14T09:01:05.925ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22332024-11-14T09:01:05.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52595 req_id = 19c0ed60-6ad3-475a-8931-83e86f7a0107 response_code = 204 uri = /vpc-routes
22342024-11-14T09:01:05.974ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22352024-11-14T09:01:05.982ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
22362024-11-14T09:01:05.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 645 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36037 req_id = ac4f289d-6a1b-4c74-90d3-2bfd7c726fac response_code = 204 uri = /eip-gateways
22372024-11-14T09:01:05.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 907 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36037 req_id = 959dfbb8-ca6c-4e74-baa9-e1a7d3f19d53 response_code = 204 uri = /vpc-routes
22382024-11-14T09:01:06.027ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49205
22392024-11-14T09:01:06.040ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22402024-11-14T09:01:06.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114222 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44247 req_id = 939f7fe4-cf11-44f1-bc58-43f9828130ec response_code = 204 uri = /switch-ports
22412024-11-14T09:01:06.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 766 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44247 req_id = 72fb64a8-5c38-45a9-ae8c-082663d1bafd response_code = 200 uri = /network-bootstore-config
22422024-11-14T09:01:06.080ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22432024-11-14T09:01:06.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43531
22442024-11-14T09:01:06.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43531 req_id = a6eb4508-f128-48ba-8295-192b3121f511 response_code = 200 uri = /v2p
22452024-11-14T09:01:06.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103612 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49205 req_id = 5438da5a-b9b4-4939-b1a9-508be8486c00 response_code = 204 uri = /switch-ports
22462024-11-14T09:01:06.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49205 req_id = 2174d480-2432-43e3-b883-463fbc518d85 response_code = 200 uri = /network-bootstore-config
22472024-11-14T09:01:23.322ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54627
22482024-11-14T09:01:23.322ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54627 req_id = dace923e-d7e7-4abf-b932-e28c4f601cba response_code = 200 uri = /baseboard
22492024-11-14T09:01:35.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49641
22502024-11-14T09:01:35.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49641 req_id = 213ae04b-aecd-40b7-bdfd-7a42a6fc8241 response_code = 200 uri = /vpc-routes
22512024-11-14T09:01:35.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61749
22522024-11-14T09:01:35.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61749 req_id = 5956c303-04e7-4235-b0f4-bc3af32ebd8d response_code = 200 uri = /v2p
22532024-11-14T09:01:35.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62429
22542024-11-14T09:01:35.585ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22552024-11-14T09:01:35.633ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22562024-11-14T09:01:35.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116437 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62429 req_id = 87444d3e-c076-4d7f-8f28-be872619414a response_code = 204 uri = /switch-ports
22572024-11-14T09:01:35.702ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
22582024-11-14T09:01:35.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49641 req_id = cb235129-9e3e-40f7-835e-4a36d6ed511d response_code = 204 uri = /eip-gateways
22592024-11-14T09:01:35.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61054
22602024-11-14T09:01:35.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34352
22612024-11-14T09:01:35.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55347
22622024-11-14T09:01:35.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61054 req_id = 3fe9393e-0cbd-43af-87a9-2d0837628ab8 response_code = 200 uri = /vpc-routes
22632024-11-14T09:01:35.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62429 req_id = e7eab378-e7e0-44ed-a60c-189e4075c73d response_code = 200 uri = /network-bootstore-config
22642024-11-14T09:01:35.702ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22652024-11-14T09:01:35.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 320 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55347 req_id = 43a13889-6641-474d-8f2d-ff825a0f2c05 response_code = 200 uri = /v2p
22662024-11-14T09:01:35.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49641 req_id = a05c843e-9281-4d5b-9f25-52dfd91e4775 response_code = 204 uri = /vpc-routes
22672024-11-14T09:01:35.719ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
22682024-11-14T09:01:35.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61054 req_id = dd2233b9-3d7e-43e2-91cc-a3f4ab267acf response_code = 204 uri = /eip-gateways
22692024-11-14T09:01:35.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55599
22702024-11-14T09:01:35.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55599 req_id = 5124a9a0-74e5-491e-8483-aca52e8fa336 response_code = 200 uri = /vpc-routes
22712024-11-14T09:01:35.748ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22722024-11-14T09:01:35.760ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
22732024-11-14T09:01:35.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55599 req_id = 1ea8289a-8d1a-4041-a302-103cfbccf14a response_code = 204 uri = /eip-gateways
22742024-11-14T09:01:35.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 563 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55599 req_id = aac117cd-cc8d-46e0-9212-87cf7d02c694 response_code = 204 uri = /vpc-routes
22752024-11-14T09:01:35.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47060
22762024-11-14T09:01:35.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113525 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34352 req_id = fa60a794-981f-4449-8f21-c7bd955c1362 response_code = 204 uri = /switch-ports
22772024-11-14T09:01:35.816ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22782024-11-14T09:01:35.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 687 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34352 req_id = 351d769e-83dc-4f1a-b598-dfe47740fdc9 response_code = 200 uri = /network-bootstore-config
22792024-11-14T09:01:35.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3984 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61054 req_id = ebed7218-4662-49c6-87b8-cea0295514f3 response_code = 204 uri = /vpc-routes
22802024-11-14T09:01:35.853ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22812024-11-14T09:01:35.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49510
22822024-11-14T09:01:35.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49510 req_id = e08abd4e-769b-43e7-8003-231b0edbfff9 response_code = 200 uri = /v2p
22832024-11-14T09:01:35.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125997 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47060 req_id = c653ded0-358f-45c0-935e-0d1aa7e4ec19 response_code = 204 uri = /switch-ports
22842024-11-14T09:01:35.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47060 req_id = ac70ea71-a838-4194-a1ff-f0524fb4e61e response_code = 200 uri = /network-bootstore-config
22852024-11-14T09:01:53.373ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36241
22862024-11-14T09:01:53.373ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36241 req_id = 85e6ba10-2bbd-4926-a423-bad6f31281d3 response_code = 200 uri = /baseboard
22872024-11-14T09:02:05.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56765
22882024-11-14T09:02:05.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56765 req_id = d81a44ad-ded5-42d4-8068-a03f5703b479 response_code = 200 uri = /v2p
22892024-11-14T09:02:05.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59612
22902024-11-14T09:02:05.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59612 req_id = e1308bee-0593-4914-a756-97df6a7d5b88 response_code = 200 uri = /vpc-routes
22912024-11-14T09:02:05.623ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
22922024-11-14T09:02:05.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59612 req_id = 1c27ad17-f954-4687-a094-87f22648ef8a response_code = 204 uri = /eip-gateways
22932024-11-14T09:02:05.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59612 req_id = b3c58448-f6ae-47df-8a0a-5c86a6be2f9a response_code = 204 uri = /vpc-routes
22942024-11-14T09:02:05.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42616
22952024-11-14T09:02:05.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42616 req_id = 4b673edf-83e1-4e81-8811-addf3e20fc17 response_code = 200 uri = /vpc-routes
22962024-11-14T09:02:05.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43960
22972024-11-14T09:02:05.772ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22982024-11-14T09:02:05.814ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22992024-11-14T09:02:05.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103169 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43960 req_id = 93b54599-42e3-4344-86ad-fe8585902e09 response_code = 204 uri = /switch-ports
23002024-11-14T09:02:05.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61743
23012024-11-14T09:02:05.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49285
23022024-11-14T09:02:05.876ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
23032024-11-14T09:02:05.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42616 req_id = 806536e8-1208-4df3-ac8e-a8fa5922c0ce response_code = 204 uri = /eip-gateways
23042024-11-14T09:02:05.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49285 req_id = 5b0cdc52-05b0-4376-9451-d7fe9a32f274 response_code = 200 uri = /v2p
23052024-11-14T09:02:05.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43960 req_id = 454505f7-1aba-4356-852f-921884e1fda2 response_code = 200 uri = /network-bootstore-config
23062024-11-14T09:02:05.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61743 req_id = 57f0e9a0-82ae-40be-ac3f-3ad5ebfdb1ff response_code = 200 uri = /vpc-routes
23072024-11-14T09:02:05.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42616 req_id = 07d43ca4-8e6c-4c26-becd-d8648c608338 response_code = 204 uri = /vpc-routes
23082024-11-14T09:02:05.891ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58122
23092024-11-14T09:02:05.891ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23102024-11-14T09:02:05.931ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23112024-11-14T09:02:05.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96439 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58122 req_id = be60ee6c-db0f-4fb2-a1e6-6e4926d63306 response_code = 204 uri = /switch-ports
23122024-11-14T09:02:05.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36777
23132024-11-14T09:02:05.988ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
23142024-11-14T09:02:05.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61743 req_id = 1ad9cc2e-2571-44f9-8915-824af2e7d573 response_code = 204 uri = /eip-gateways
23152024-11-14T09:02:05.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36777 req_id = 6bc42861-1515-461d-b432-0f89f4bf2f62 response_code = 200 uri = /v2p
23162024-11-14T09:02:05.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58122 req_id = af8335bb-2df3-4003-9755-d01a8c22315b response_code = 200 uri = /network-bootstore-config
23172024-11-14T09:02:05.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48412
23182024-11-14T09:02:05.989ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23192024-11-14T09:02:06.029ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23202024-11-14T09:02:06.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97724 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48412 req_id = 8b94f6c5-aedf-4fe8-afcd-9907902b0b43 response_code = 204 uri = /switch-ports
23212024-11-14T09:02:06.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48412 req_id = 863c2ea1-1ab0-4cbc-a653-7aed6fec83c5 response_code = 200 uri = /network-bootstore-config
23222024-11-14T09:02:06.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61743 req_id = 7b4ea539-60e1-4f45-bdc5-4d87dca8e76a response_code = 204 uri = /vpc-routes
23232024-11-14T09:02:23.407ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34049
23242024-11-14T09:02:23.407ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34049 req_id = 523ebc3b-42b3-4e99-8513-2193d728d39a response_code = 200 uri = /baseboard
23252024-11-14T09:02:35.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65239
23262024-11-14T09:02:35.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65239 req_id = 3ba6e364-2ecf-406b-bde4-f1b5a6ed9fdd response_code = 200 uri = /vpc-routes
23272024-11-14T09:02:35.459ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
23282024-11-14T09:02:35.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65239 req_id = fa0af902-3f14-439b-a97a-a490eaaa73ed response_code = 204 uri = /eip-gateways
23292024-11-14T09:02:35.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65239 req_id = fbda8b66-0dbd-49f9-9848-231d37baa2ac response_code = 204 uri = /vpc-routes
23302024-11-14T09:02:35.526ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58026
23312024-11-14T09:02:35.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58026 req_id = de803b28-9630-4b56-8946-3ec328d52226 response_code = 200 uri = /v2p
23322024-11-14T09:02:35.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34078
23332024-11-14T09:02:35.527ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23342024-11-14T09:02:35.580ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23352024-11-14T09:02:35.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130162 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34078 req_id = 3cee8e1c-3c51-4728-bf29-b4f131e14f40 response_code = 204 uri = /switch-ports
23362024-11-14T09:02:35.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60474
23372024-11-14T09:02:35.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60474 req_id = 58006849-c199-41aa-9e0c-409d0536e2b3 response_code = 200 uri = /vpc-routes
23382024-11-14T09:02:35.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34078 req_id = a085ae7a-1d32-4e72-a86d-910154e013a8 response_code = 200 uri = /network-bootstore-config
23392024-11-14T09:02:35.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50133
23402024-11-14T09:02:35.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50133 req_id = dc539287-4cac-4466-91fa-4e875c9b1c61 response_code = 200 uri = /v2p
23412024-11-14T09:02:35.725ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
23422024-11-14T09:02:35.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60474 req_id = d910cfeb-a65d-4066-be5c-62bb48049653 response_code = 204 uri = /eip-gateways
23432024-11-14T09:02:35.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47783
23442024-11-14T09:02:35.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47783 req_id = f9a0344a-d8f1-467c-945b-352f98ac78fb response_code = 200 uri = /vpc-routes
23452024-11-14T09:02:35.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60474 req_id = 95f05084-0387-45e0-a732-5bb067e1ae26 response_code = 204 uri = /vpc-routes
23462024-11-14T09:02:35.752ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
23472024-11-14T09:02:35.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47783 req_id = 9d15df9d-9dab-430f-a0fb-f4c42b5bd24e response_code = 204 uri = /eip-gateways
23482024-11-14T09:02:35.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37184
23492024-11-14T09:02:35.758ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23502024-11-14T09:02:35.799ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23512024-11-14T09:02:35.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100760 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37184 req_id = a938d324-c183-461c-a946-86f938d84c91 response_code = 204 uri = /switch-ports
23522024-11-14T09:02:35.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35675
23532024-11-14T09:02:35.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35675 req_id = c3c763bd-3ff5-4260-8a28-a059ae001410 response_code = 200 uri = /v2p
23542024-11-14T09:02:35.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37184 req_id = 3c34ca33-7f18-415c-b810-e7ed838a90bf response_code = 200 uri = /network-bootstore-config
23552024-11-14T09:02:35.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47783 req_id = ca1a7ed3-ff69-459e-ac3e-ce6e2601f4b0 response_code = 204 uri = /vpc-routes
23562024-11-14T09:02:35.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45224
23572024-11-14T09:02:35.861ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23582024-11-14T09:02:35.897ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23592024-11-14T09:02:35.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90374 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45224 req_id = cb57f858-24c8-449c-9a2a-abf658a8e440 response_code = 204 uri = /switch-ports
23602024-11-14T09:02:35.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45224 req_id = 6b3ecab0-e11a-4bba-9dbb-40ff461a8a37 response_code = 200 uri = /network-bootstore-config
23612024-11-14T09:02:53.440ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40502
23622024-11-14T09:02:53.440ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40502 req_id = 209a5791-dd25-4b7c-8618-13b1ec31f002 response_code = 200 uri = /baseboard
23632024-11-14T09:03:05.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63157
23642024-11-14T09:03:05.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63157 req_id = 1a0d214c-b912-47c0-bb89-2f1b2bf32c4a response_code = 200 uri = /vpc-routes
23652024-11-14T09:03:05.762ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
23662024-11-14T09:03:05.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63157 req_id = 359f9d16-9293-40c1-a687-60f59f57c653 response_code = 204 uri = /eip-gateways
23672024-11-14T09:03:05.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63157 req_id = e9d592dc-3d2c-4d89-a809-0fd9e2358c11 response_code = 204 uri = /vpc-routes
23682024-11-14T09:03:05.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37553
23692024-11-14T09:03:05.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37553 req_id = f59a5640-e246-4cb5-bbba-1fa8db83453e response_code = 200 uri = /vpc-routes
23702024-11-14T09:03:05.806ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
23712024-11-14T09:03:05.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37553 req_id = 73bf2e0d-0641-4d92-9e6c-862db670ce27 response_code = 204 uri = /eip-gateways
23722024-11-14T09:03:05.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37553 req_id = 6f6fd206-b6a5-4661-a958-f3c07ade6e14 response_code = 204 uri = /vpc-routes
23732024-11-14T09:03:05.842ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41402
23742024-11-14T09:03:05.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41402 req_id = 3d293c69-517b-487f-8e93-a1cfbd22d2df response_code = 200 uri = /v2p
23752024-11-14T09:03:05.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51674
23762024-11-14T09:03:05.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51674 req_id = a2526c21-ff50-4f0a-b1c5-7354f3ba71c3 response_code = 200 uri = /vpc-routes
23772024-11-14T09:03:05.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40603
23782024-11-14T09:03:05.861ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23792024-11-14T09:03:05.911ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23802024-11-14T09:03:05.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120725 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40603 req_id = 7f7b54ed-6a0e-4a2c-b2ca-49e383375e43 response_code = 204 uri = /switch-ports
23812024-11-14T09:03:05.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39026
23822024-11-14T09:03:05.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47814
23832024-11-14T09:03:05.982ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
23842024-11-14T09:03:05.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51674 req_id = ec559efb-d0a3-430d-a64e-c5e0bb6be2fa response_code = 204 uri = /eip-gateways
23852024-11-14T09:03:05.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40603 req_id = 6ae421ec-84ed-474a-9910-3132c531a700 response_code = 200 uri = /network-bootstore-config
23862024-11-14T09:03:05.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39026 req_id = 715640b3-c9f8-4d08-afcc-09ef3fa21a94 response_code = 200 uri = /v2p
23872024-11-14T09:03:05.982ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23882024-11-14T09:03:06.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36682
23892024-11-14T09:03:06.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36682 req_id = 3880fce8-2a12-4135-ad3d-27cbcc5930c0 response_code = 200 uri = /v2p
23902024-11-14T09:03:06.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51674 req_id = 37441bdf-096d-4688-9e39-b2584895760b response_code = 204 uri = /vpc-routes
23912024-11-14T09:03:06.026ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23922024-11-14T09:03:06.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55580
23932024-11-14T09:03:06.080ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23942024-11-14T09:03:06.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98532 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47814 req_id = aad7675e-a379-4b45-bf73-bda8ebfc98e3 response_code = 204 uri = /switch-ports
23952024-11-14T09:03:06.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 590 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47814 req_id = 3f0e6704-e1b1-4856-9b6d-a5f4a707a02b response_code = 200 uri = /network-bootstore-config
23962024-11-14T09:03:06.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34217
23972024-11-14T09:03:06.089ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 208292a9-20b7-485e-95b8-8fa301192abc, kind: Service { id: ef32bdd5-939a-4ab0-a70a-6f004e97691b }, name: Name("external-dns-ef32bdd5-939a-4ab0-a70a-6f004e97691b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 49])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7b6a42b1-a060-4782-a598-da956f0e54bf, kind: Service { id: e0fbd02e-9643-47c5-9261-dd03abc268a8 }, name: Name("external-dns-e0fbd02e-9643-47c5-9261-dd03abc268a8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3d08f9bf-1395-4918-83ef-e9bf23bb54cc, kind: Service { id: d3dd4036-6839-48d6-8f36-e642d9b3e6c0 }, name: Name("nexus-d3dd4036-6839-48d6-8f36-e642d9b3e6c0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 97])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eb09bf8b-0a0a-43d0-8fab-de971f1991ea, kind: Service { id: b933d23e-28f4-4f5e-9ad9-9694702ed335 }, name: Name("nexus-b933d23e-28f4-4f5e-9ad9-9694702ed335"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f73311b5-bba3-40b6-b24a-8c3229a71a49, kind: Service { id: 484a1c50-302f-49ec-9214-2179c2ff7104 }, name: Name("nexus-484a1c50-302f-49ec-9214-2179c2ff7104"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23982024-11-14T09:03:06.089ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23992024-11-14T09:03:06.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24002024-11-14T09:03:06.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24012024-11-14T09:03:06.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
24022024-11-14T09:03:06.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24032024-11-14T09:03:06.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24042024-11-14T09:03:06.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34217 req_id = 087f2943-3cb4-4b21-aa61-69dbed4c09bb response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24052024-11-14T09:03:06.116ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24062024-11-14T09:03:06.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43964
24072024-11-14T09:03:06.130ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 208292a9-20b7-485e-95b8-8fa301192abc, kind: Service { id: ef32bdd5-939a-4ab0-a70a-6f004e97691b }, name: Name("external-dns-ef32bdd5-939a-4ab0-a70a-6f004e97691b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 49])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7b6a42b1-a060-4782-a598-da956f0e54bf, kind: Service { id: e0fbd02e-9643-47c5-9261-dd03abc268a8 }, name: Name("external-dns-e0fbd02e-9643-47c5-9261-dd03abc268a8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3d08f9bf-1395-4918-83ef-e9bf23bb54cc, kind: Service { id: d3dd4036-6839-48d6-8f36-e642d9b3e6c0 }, name: Name("nexus-d3dd4036-6839-48d6-8f36-e642d9b3e6c0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 97])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eb09bf8b-0a0a-43d0-8fab-de971f1991ea, kind: Service { id: b933d23e-28f4-4f5e-9ad9-9694702ed335 }, name: Name("nexus-b933d23e-28f4-4f5e-9ad9-9694702ed335"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f73311b5-bba3-40b6-b24a-8c3229a71a49, kind: Service { id: 484a1c50-302f-49ec-9214-2179c2ff7104 }, name: Name("nexus-484a1c50-302f-49ec-9214-2179c2ff7104"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24082024-11-14T09:03:06.130ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24092024-11-14T09:03:06.130ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24102024-11-14T09:03:06.130ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24112024-11-14T09:03:06.130ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
24122024-11-14T09:03:06.130ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24132024-11-14T09:03:06.130ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24142024-11-14T09:03:06.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 388 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43964 req_id = 9be8da3b-ffbc-420f-a714-f403c136e9ce response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24152024-11-14T09:03:06.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64173
24162024-11-14T09:03:06.140ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 208292a9-20b7-485e-95b8-8fa301192abc, kind: Service { id: ef32bdd5-939a-4ab0-a70a-6f004e97691b }, name: Name("external-dns-ef32bdd5-939a-4ab0-a70a-6f004e97691b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 49])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7b6a42b1-a060-4782-a598-da956f0e54bf, kind: Service { id: e0fbd02e-9643-47c5-9261-dd03abc268a8 }, name: Name("external-dns-e0fbd02e-9643-47c5-9261-dd03abc268a8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3d08f9bf-1395-4918-83ef-e9bf23bb54cc, kind: Service { id: d3dd4036-6839-48d6-8f36-e642d9b3e6c0 }, name: Name("nexus-d3dd4036-6839-48d6-8f36-e642d9b3e6c0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 97])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eb09bf8b-0a0a-43d0-8fab-de971f1991ea, kind: Service { id: b933d23e-28f4-4f5e-9ad9-9694702ed335 }, name: Name("nexus-b933d23e-28f4-4f5e-9ad9-9694702ed335"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f73311b5-bba3-40b6-b24a-8c3229a71a49, kind: Service { id: 484a1c50-302f-49ec-9214-2179c2ff7104 }, name: Name("nexus-484a1c50-302f-49ec-9214-2179c2ff7104"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24172024-11-14T09:03:06.140ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24182024-11-14T09:03:06.140ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24192024-11-14T09:03:06.140ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24202024-11-14T09:03:06.140ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
24212024-11-14T09:03:06.140ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24222024-11-14T09:03:06.140ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24232024-11-14T09:03:06.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 393 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64173 req_id = ecc81ee5-31d2-452d-b670-3be27955cd4b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24242024-11-14T09:03:06.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115378 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55580 req_id = 51ea2263-040e-489a-b966-7625d48eb1ee response_code = 204 uri = /switch-ports
24252024-11-14T09:03:06.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55580 req_id = 55ba8c6a-8527-4aba-b6e1-bab9fc393cea response_code = 200 uri = /network-bootstore-config
24262024-11-14T09:03:23.474ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49889
24272024-11-14T09:03:23.474ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49889 req_id = 261d7902-23b5-40ff-8f1e-4af672606f80 response_code = 200 uri = /baseboard
24282024-11-14T09:03:35.488ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60439
24292024-11-14T09:03:35.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60439 req_id = e83cfae1-2c9e-490d-9d15-fcb5f649b958 response_code = 200 uri = /vpc-routes
24302024-11-14T09:03:35.514ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
24312024-11-14T09:03:35.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60439 req_id = 386f8449-59f7-43b8-9331-44d779fa6d3b response_code = 204 uri = /eip-gateways
24322024-11-14T09:03:35.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60439 req_id = f9c1f53d-4123-4118-96b6-f818681ed899 response_code = 204 uri = /vpc-routes
24332024-11-14T09:03:35.586ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52962
24342024-11-14T09:03:35.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52962 req_id = ce7d6628-2b42-43ba-83af-09c875af69f7 response_code = 200 uri = /vpc-routes
24352024-11-14T09:03:35.605ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
24362024-11-14T09:03:35.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52962 req_id = 10c45159-3e46-40ba-9067-d7d8afd39295 response_code = 204 uri = /eip-gateways
24372024-11-14T09:03:35.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52962 req_id = 98a74d45-e6d9-4f7e-b4e3-831acf1e770f response_code = 204 uri = /vpc-routes
24382024-11-14T09:03:35.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36379
24392024-11-14T09:03:35.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36379 req_id = 19a9d184-25bf-4402-b4cc-fd969565539b response_code = 200 uri = /v2p
24402024-11-14T09:03:35.695ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64135
24412024-11-14T09:03:35.695ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24422024-11-14T09:03:35.741ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24432024-11-14T09:03:35.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107143 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64135 req_id = ab9982a1-7341-4f01-872a-244c0fcd8592 response_code = 204 uri = /switch-ports
24442024-11-14T09:03:35.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48016
24452024-11-14T09:03:35.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63606
24462024-11-14T09:03:35.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63606 req_id = 98df652b-e45a-4012-ab23-25936776001c response_code = 200 uri = /vpc-routes
24472024-11-14T09:03:35.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64135 req_id = 6fb4e53a-9259-4937-b836-047473c73623 response_code = 200 uri = /network-bootstore-config
24482024-11-14T09:03:35.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48016 req_id = ef4f363b-ee20-4fdd-b84a-cc227d211326 response_code = 200 uri = /v2p
24492024-11-14T09:03:35.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52399
24502024-11-14T09:03:35.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52399 req_id = 5423a43f-b6b5-4591-94f5-dfca18483461 response_code = 200 uri = /v2p
24512024-11-14T09:03:35.820ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
24522024-11-14T09:03:35.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63606 req_id = c27a3aac-ad27-41b1-9bc1-87418ec63a0b response_code = 204 uri = /eip-gateways
24532024-11-14T09:03:35.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37450
24542024-11-14T09:03:35.828ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24552024-11-14T09:03:35.866ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24562024-11-14T09:03:35.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95218 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37450 req_id = 374fa9c0-2c14-40a0-a56d-b897c24bd68d response_code = 204 uri = /switch-ports
24572024-11-14T09:03:35.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65266
24582024-11-14T09:03:35.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63606 req_id = 4404558c-0912-4cb0-a5a1-5e111ffcdcf8 response_code = 204 uri = /vpc-routes
24592024-11-14T09:03:35.924ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24602024-11-14T09:03:35.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37450 req_id = 4d86d21f-05cc-4aae-9b33-3a6d8a557419 response_code = 200 uri = /network-bootstore-config
24612024-11-14T09:03:35.966ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24622024-11-14T09:03:36.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99538 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65266 req_id = 005149c5-a954-49ab-87cb-6ac892835c89 response_code = 204 uri = /switch-ports
24632024-11-14T09:03:36.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65266 req_id = b9600930-d2b0-49c3-af48-1c13ceb0ae20 response_code = 200 uri = /network-bootstore-config
24642024-11-14T09:03:53.507ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34984
24652024-11-14T09:03:53.507ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34984 req_id = b3db31f1-8898-466c-9934-12ac784c7ddb response_code = 200 uri = /baseboard
24662024-11-14T09:04:05.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55409
24672024-11-14T09:04:05.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55409 req_id = e5d0d0ba-491a-4395-b467-2ee92013e6c9 response_code = 200 uri = /vpc-routes
24682024-11-14T09:04:05.634ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
24692024-11-14T09:04:05.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55409 req_id = 784ba36b-841c-425d-a0e8-4d8b199d816f response_code = 204 uri = /eip-gateways
24702024-11-14T09:04:05.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46204
24712024-11-14T09:04:05.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46204 req_id = 68cb4000-e508-4548-86d8-4d21aa2e52d5 response_code = 200 uri = /vpc-routes
24722024-11-14T09:04:05.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32854
24732024-11-14T09:04:05.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32854 req_id = 1588a160-a6ca-470a-bf54-c6039cc17229 response_code = 200 uri = /v2p
24742024-11-14T09:04:05.767ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
24752024-11-14T09:04:05.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46204 req_id = 5f3b6079-d174-47c9-bb37-740fa27b2ad4 response_code = 204 uri = /eip-gateways
24762024-11-14T09:04:05.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55409 req_id = 5a49fc08-ebd8-409f-9e25-2048a867eb54 response_code = 204 uri = /vpc-routes
24772024-11-14T09:04:05.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46204 req_id = c09f962c-e6ff-4094-b14c-1492059ee9fc response_code = 204 uri = /vpc-routes
24782024-11-14T09:04:05.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38562
24792024-11-14T09:04:05.828ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24802024-11-14T09:04:05.866ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24812024-11-14T09:04:05.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98472 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38562 req_id = 6d3de2ee-4e14-4bd0-bee5-b2f98b5a295b response_code = 204 uri = /switch-ports
24822024-11-14T09:04:05.926ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62422
24832024-11-14T09:04:05.926ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38639
24842024-11-14T09:04:05.926ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24852024-11-14T09:04:05.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4393 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38562 req_id = a056cf50-fb4e-463a-a30f-8500891d963a response_code = 200 uri = /network-bootstore-config
24862024-11-14T09:04:05.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4649 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62422 req_id = a4671eae-1d54-4362-8e00-14703b155e72 response_code = 200 uri = /v2p
24872024-11-14T09:04:05.967ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24882024-11-14T09:04:05.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34052
24892024-11-14T09:04:05.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34052 req_id = e02d793b-0931-4f05-add4-a32b3fb666dc response_code = 200 uri = /vpc-routes
24902024-11-14T09:04:05.991ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
24912024-11-14T09:04:05.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34052 req_id = beae8655-1285-468b-98d1-836f00fab17c response_code = 204 uri = /eip-gateways
24922024-11-14T09:04:06.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3483 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34052 req_id = 73e9c70d-0f35-444d-bd09-f48a9d53ec6d response_code = 204 uri = /vpc-routes
24932024-11-14T09:04:06.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126384 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38639 req_id = 027f5604-18cf-4c08-b2ae-ed5def4098ad response_code = 204 uri = /switch-ports
24942024-11-14T09:04:06.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38639 req_id = 98938070-2fd1-455e-ae8d-5a3b9537b397 response_code = 200 uri = /network-bootstore-config
24952024-11-14T09:04:06.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55552
24962024-11-14T09:04:06.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55552 req_id = a44e1f30-0719-4ffa-a622-a2726c7fdba5 response_code = 200 uri = /v2p
24972024-11-14T09:04:06.131ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58088
24982024-11-14T09:04:06.131ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24992024-11-14T09:04:06.172ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25002024-11-14T09:04:06.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101401 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58088 req_id = 253542d1-d628-4b32-ad9a-d147ee20825b response_code = 204 uri = /switch-ports
25012024-11-14T09:04:06.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58088 req_id = c961b6b2-9c2b-4123-ac6a-3f87a5a254de response_code = 200 uri = /network-bootstore-config
25022024-11-14T09:04:23.540ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40045
25032024-11-14T09:04:23.540ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40045 req_id = f89a1ceb-8d67-4b6a-8bca-2b65040405dd response_code = 200 uri = /baseboard
25042024-11-14T09:04:35.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35556
25052024-11-14T09:04:35.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35556 req_id = 080677a3-1e6f-433f-b644-bc16f935d123 response_code = 200 uri = /vpc-routes
25062024-11-14T09:04:35.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42675
25072024-11-14T09:04:35.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42675 req_id = 299210c8-1ef3-483c-841e-aef04ac86a08 response_code = 200 uri = /v2p
25082024-11-14T09:04:35.520ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
25092024-11-14T09:04:35.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35556 req_id = 090be350-8cfa-4305-9455-0b60ad55a7ca response_code = 204 uri = /eip-gateways
25102024-11-14T09:04:35.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35556 req_id = 6a48a86e-3278-4340-90fe-4ef39e62f558 response_code = 204 uri = /vpc-routes
25112024-11-14T09:04:35.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32875
25122024-11-14T09:04:35.542ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25132024-11-14T09:04:35.607ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25142024-11-14T09:04:35.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155019 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:32875 req_id = 2243ae6a-25ae-41f7-b8a2-70d8a8ac7823 response_code = 204 uri = /switch-ports
25152024-11-14T09:04:35.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53396
25162024-11-14T09:04:35.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56136
25172024-11-14T09:04:35.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53396 req_id = 2798aa8c-2eb5-47e0-95a1-2fa58f7008ca response_code = 200 uri = /vpc-routes
25182024-11-14T09:04:35.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 342 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32875 req_id = a0b259ed-06fc-434a-8eca-79023930bad5 response_code = 200 uri = /network-bootstore-config
25192024-11-14T09:04:35.698ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25202024-11-14T09:04:35.753ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25212024-11-14T09:04:35.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41837
25222024-11-14T09:04:35.758ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
25232024-11-14T09:04:35.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 807 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53396 req_id = 29b11762-4560-41be-bacd-6976c9461f17 response_code = 204 uri = /eip-gateways
25242024-11-14T09:04:35.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41837 req_id = 4f7b6df0-ac7d-4f98-b931-458d362ea95d response_code = 200 uri = /v2p
25252024-11-14T09:04:35.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 865 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53396 req_id = 82cb3ece-16dd-42fc-bcfe-e981cd969a22 response_code = 204 uri = /vpc-routes
25262024-11-14T09:04:35.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35433
25272024-11-14T09:04:35.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35433 req_id = f4e1df1b-83cf-4a12-b81f-7a27cc5431c0 response_code = 200 uri = /vpc-routes
25282024-11-14T09:04:35.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129577 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56136 req_id = 2822a4a0-ada6-4b1f-abde-9bf5cd5f0eb4 response_code = 204 uri = /switch-ports
25292024-11-14T09:04:35.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56136 req_id = f8f1ff4c-4f78-4adb-8451-c891945c8215 response_code = 200 uri = /network-bootstore-config
25302024-11-14T09:04:35.878ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
25312024-11-14T09:04:35.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35433 req_id = cd77204c-a95f-43f4-965e-0ed33b8badf5 response_code = 204 uri = /eip-gateways
25322024-11-14T09:04:35.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35433 req_id = c5ddbfa1-b986-428e-ba12-924bbcf2914e response_code = 204 uri = /vpc-routes
25332024-11-14T09:04:35.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35526
25342024-11-14T09:04:35.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35526 req_id = ffdc1a16-2358-45e5-a950-2c5275459ae2 response_code = 200 uri = /v2p
25352024-11-14T09:04:35.934ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41077
25362024-11-14T09:04:35.934ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25372024-11-14T09:04:35.973ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25382024-11-14T09:04:36.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102806 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41077 req_id = 0272c96d-29d2-4a18-9134-cc31ed8979d7 response_code = 204 uri = /switch-ports
25392024-11-14T09:04:36.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41077 req_id = f734e6af-ec0f-4f95-86ca-74e1f0199afb response_code = 200 uri = /network-bootstore-config
25402024-11-14T09:04:53.574ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35047
25412024-11-14T09:04:53.574ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35047 req_id = f5c3969a-fb62-4316-a232-bdeb0920f659 response_code = 200 uri = /baseboard
25422024-11-14T09:05:05.645ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39947
25432024-11-14T09:05:05.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39947 req_id = cad30c1b-7953-4bf1-b221-84cb906cfb5c response_code = 200 uri = /vpc-routes
25442024-11-14T09:05:05.696ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
25452024-11-14T09:05:05.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39947 req_id = 7f5c855b-a352-4f22-ae09-5221f78dd6e0 response_code = 204 uri = /eip-gateways
25462024-11-14T09:05:05.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39947 req_id = f941c7ef-97e3-4663-9cb6-ed39883cd5cc response_code = 204 uri = /vpc-routes
25472024-11-14T09:05:05.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44150
25482024-11-14T09:05:05.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44150 req_id = 19bdbbcd-bd4c-4c0d-b17f-04e3220cf7a4 response_code = 200 uri = /vpc-routes
25492024-11-14T09:05:05.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62897
25502024-11-14T09:05:05.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62897 req_id = 8ba2d24b-2b9e-415c-b83c-375c1ea4a869 response_code = 200 uri = /v2p
25512024-11-14T09:05:05.778ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
25522024-11-14T09:05:05.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44150 req_id = 1e33527b-a113-4057-96e5-006c3a03609e response_code = 204 uri = /eip-gateways
25532024-11-14T09:05:05.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42576
25542024-11-14T09:05:05.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42576 req_id = d7a56333-749f-46bd-ac71-509d44afb06f response_code = 200 uri = /v2p
25552024-11-14T09:05:05.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44150 req_id = a03283a3-c7ed-4f6b-9a24-a023a6304d4a response_code = 204 uri = /vpc-routes
25562024-11-14T09:05:05.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38007
25572024-11-14T09:05:05.829ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25582024-11-14T09:05:05.869ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25592024-11-14T09:05:05.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102595 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38007 req_id = 025c5a7b-3172-4693-8388-2ef19d9ae11f response_code = 204 uri = /switch-ports
25602024-11-14T09:05:05.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55885
25612024-11-14T09:05:05.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38187
25622024-11-14T09:05:05.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40156
25632024-11-14T09:05:05.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5939 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40156 req_id = 878d654d-4cd2-48a1-8ebb-a5a861343a8b response_code = 200 uri = /v2p
25642024-11-14T09:05:05.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38007 req_id = c965e4df-dae0-4e64-9e9e-cfb146230bf9 response_code = 200 uri = /network-bootstore-config
25652024-11-14T09:05:05.939ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25662024-11-14T09:05:05.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55885 req_id = 09d0f15e-02d3-4771-a80d-93a46a95d31c response_code = 200 uri = /vpc-routes
25672024-11-14T09:05:05.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34488
25682024-11-14T09:05:05.982ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
25692024-11-14T09:05:05.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55885 req_id = 6625b3b5-4ce9-4b3e-bbc7-b632fee70605 response_code = 204 uri = /eip-gateways
25702024-11-14T09:05:05.987ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25712024-11-14T09:05:05.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 831 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55885 req_id = ac7f87b1-dd93-412f-906d-be2bbd4f6a79 response_code = 204 uri = /vpc-routes
25722024-11-14T09:05:06.055ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25732024-11-14T09:05:06.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116967 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38187 req_id = b2081c5a-27c0-443c-a0b2-d6ac965a2cdd response_code = 204 uri = /switch-ports
25742024-11-14T09:05:06.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 650 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38187 req_id = 19876af8-802f-4ad7-b980-2df78c74df63 response_code = 200 uri = /network-bootstore-config
25752024-11-14T09:05:06.090ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25762024-11-14T09:05:06.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185183 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34488 req_id = b4f8ebe8-28bf-437b-ba35-d122f42b4ae4 response_code = 204 uri = /switch-ports
25772024-11-14T09:05:06.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34488 req_id = 9d43dbfa-49c1-4f18-a17b-3a47c7750a10 response_code = 200 uri = /network-bootstore-config
25782024-11-14T09:05:13.217ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
25792024-11-14T09:05:13.220ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
25802024-11-14T09:05:13.221ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
25812024-11-14T09:05:13.221ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
25822024-11-14T09:05:13.222ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
25832024-11-14T09:05:13.223ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
25842024-11-14T09:05:13.224ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
25852024-11-14T09:05:17.945ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
25862024-11-14T09:05:17.946ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
25872024-11-14T09:05:22.473ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
25882024-11-14T09:05:22.474ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
25892024-11-14T09:05:22.475ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
25902024-11-14T09:05:22.476ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
25912024-11-14T09:05:22.477ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
25922024-11-14T09:05:22.477ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
25932024-11-14T09:05:22.479ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
25942024-11-14T09:05:23.221ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
25952024-11-14T09:05:23.222ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
25962024-11-14T09:05:23.223ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
25972024-11-14T09:05:23.223ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
25982024-11-14T09:05:23.224ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
25992024-11-14T09:05:23.224ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26002024-11-14T09:05:23.225ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26012024-11-14T09:05:23.225ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26022024-11-14T09:05:23.226ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26032024-11-14T09:05:23.607ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46720
26042024-11-14T09:05:23.607ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46720 req_id = 2cac476d-3243-4e12-986b-f362a7500609 response_code = 200 uri = /baseboard
26052024-11-14T09:05:27.950ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26062024-11-14T09:05:27.951ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26072024-11-14T09:05:29.743ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
26082024-11-14T09:05:29.744ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26092024-11-14T09:05:29.784ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 2137, tv_nsec: 571910785 } time_to_next_cleanup = 599.9999982s
26102024-11-14T09:05:32.476ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26112024-11-14T09:05:32.477ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26122024-11-14T09:05:32.478ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26132024-11-14T09:05:32.478ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26142024-11-14T09:05:32.479ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26152024-11-14T09:05:32.480ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26162024-11-14T09:05:32.481ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26172024-11-14T09:05:33.224ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26182024-11-14T09:05:33.225ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26192024-11-14T09:05:33.225ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26202024-11-14T09:05:33.226ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26212024-11-14T09:05:33.227ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26222024-11-14T09:05:33.227ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26232024-11-14T09:05:33.228ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26242024-11-14T09:05:33.229ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26252024-11-14T09:05:33.229ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26262024-11-14T09:05:35.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52820
26272024-11-14T09:05:35.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52820 req_id = d5fc827b-131e-41bf-896d-47459d2c28f2 response_code = 200 uri = /vpc-routes
26282024-11-14T09:05:35.551ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
26292024-11-14T09:05:35.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52820 req_id = e2c88999-a782-4ebf-874e-1787fe7f3966 response_code = 204 uri = /eip-gateways
26302024-11-14T09:05:35.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52820 req_id = d23e9550-4ed9-4422-bf44-f544d05e7642 response_code = 204 uri = /vpc-routes
26312024-11-14T09:05:35.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43621
26322024-11-14T09:05:35.602ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26332024-11-14T09:05:35.649ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26342024-11-14T09:05:35.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107396 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43621 req_id = fe67861c-1ea7-47dd-aaa9-10d174c7ad89 response_code = 204 uri = /switch-ports
26352024-11-14T09:05:35.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55568
26362024-11-14T09:05:35.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55568 req_id = 00bafaf3-627a-43dd-be38-f642a67b65c6 response_code = 200 uri = /v2p
26372024-11-14T09:05:35.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43621 req_id = 7d5f4964-0074-4a36-bdbc-d53b8724e388 response_code = 200 uri = /network-bootstore-config
26382024-11-14T09:05:35.731ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50272
26392024-11-14T09:05:35.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50272 req_id = ea15e3a4-55d7-4aba-b902-5025716d5de8 response_code = 200 uri = /vpc-routes
26402024-11-14T09:05:35.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61457
26412024-11-14T09:05:35.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61457 req_id = 0a53289e-b4ab-4f0a-b30f-6cee2bfb50b4 response_code = 200 uri = /vpc-routes
26422024-11-14T09:05:35.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48385
26432024-11-14T09:05:35.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48385 req_id = 5efc470e-da72-40ff-8bcf-dfe689fce4cc response_code = 200 uri = /v2p
26442024-11-14T09:05:35.754ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
26452024-11-14T09:05:35.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61457 req_id = 5cfa7448-f3a7-4c77-b3fb-e42ce584b9b7 response_code = 204 uri = /eip-gateways
26462024-11-14T09:05:35.760ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
26472024-11-14T09:05:35.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50272 req_id = 2dc44b67-803e-4101-b890-0a75da9469bd response_code = 204 uri = /eip-gateways
26482024-11-14T09:05:35.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50272 req_id = 8835cf85-8bb1-4880-80b3-e3804cf5952c response_code = 204 uri = /vpc-routes
26492024-11-14T09:05:35.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36783
26502024-11-14T09:05:35.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36783 req_id = 6a66b8a8-f945-4f63-8672-a481ea3f4766 response_code = 200 uri = /v2p
26512024-11-14T09:05:35.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61457 req_id = 2d3319f0-8331-45ef-be44-a5a300f200eb response_code = 204 uri = /vpc-routes
26522024-11-14T09:05:35.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54662
26532024-11-14T09:05:35.841ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26542024-11-14T09:05:35.878ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26552024-11-14T09:05:35.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95965 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54662 req_id = 7e3b5941-75aa-40e3-9998-dc60f96fd871 response_code = 204 uri = /switch-ports
26562024-11-14T09:05:35.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54662 req_id = 7ae21e34-7530-47ab-913e-07c4eae9882c response_code = 200 uri = /network-bootstore-config
26572024-11-14T09:05:36.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61782
26582024-11-14T09:05:36.032ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26592024-11-14T09:05:36.073ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26602024-11-14T09:05:36.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98452 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61782 req_id = 09619b58-fdf3-4a44-9301-bf36a7f2beff response_code = 204 uri = /switch-ports
26612024-11-14T09:05:36.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61782 req_id = 6242232a-de84-423e-9c9e-8b103852e81b response_code = 200 uri = /network-bootstore-config
26622024-11-14T09:05:37.955ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26632024-11-14T09:05:37.956ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26642024-11-14T09:05:42.478ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26652024-11-14T09:05:42.479ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26662024-11-14T09:05:42.480ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26672024-11-14T09:05:42.480ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26682024-11-14T09:05:42.481ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26692024-11-14T09:05:42.482ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26702024-11-14T09:05:42.483ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26712024-11-14T09:05:43.227ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26722024-11-14T09:05:43.227ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26732024-11-14T09:05:43.228ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26742024-11-14T09:05:43.229ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26752024-11-14T09:05:43.229ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26762024-11-14T09:05:43.230ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26772024-11-14T09:05:43.231ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26782024-11-14T09:05:43.231ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26792024-11-14T09:05:43.232ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26802024-11-14T09:05:44.857ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
26812024-11-14T09:05:47.959ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26822024-11-14T09:05:47.960ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26832024-11-14T09:05:52.480ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26842024-11-14T09:05:52.481ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26852024-11-14T09:05:52.482ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26862024-11-14T09:05:52.483ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26872024-11-14T09:05:52.483ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26882024-11-14T09:05:52.484ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26892024-11-14T09:05:52.486ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26902024-11-14T09:05:53.231ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26912024-11-14T09:05:53.234ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26922024-11-14T09:05:53.234ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26932024-11-14T09:05:53.234ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26942024-11-14T09:05:53.235ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26952024-11-14T09:05:53.235ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26962024-11-14T09:05:53.236ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26972024-11-14T09:05:53.237ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26982024-11-14T09:05:53.237ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
26992024-11-14T09:05:53.639ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33259
27002024-11-14T09:05:53.639ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33259 req_id = cad03e12-996b-4dcd-9fbb-6750fae8e077 response_code = 200 uri = /baseboard
27012024-11-14T09:05:57.964ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27022024-11-14T09:05:57.965ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27032024-11-14T09:06:02.483ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27042024-11-14T09:06:02.484ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27052024-11-14T09:06:02.484ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27062024-11-14T09:06:02.485ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27072024-11-14T09:06:02.486ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27082024-11-14T09:06:02.486ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27092024-11-14T09:06:02.488ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27102024-11-14T09:06:03.234ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27112024-11-14T09:06:03.235ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27122024-11-14T09:06:03.235ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27132024-11-14T09:06:03.236ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27142024-11-14T09:06:03.237ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27152024-11-14T09:06:03.238ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27162024-11-14T09:06:03.238ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27172024-11-14T09:06:03.239ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27182024-11-14T09:06:03.239ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27192024-11-14T09:06:05.574ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42186
27202024-11-14T09:06:05.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42186 req_id = 4756ac9e-861b-49a6-969b-e6d633fd924f response_code = 200 uri = /vpc-routes
27212024-11-14T09:06:05.609ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
27222024-11-14T09:06:05.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42186 req_id = d752bf06-3d95-4010-aa37-3dbc0fcb5272 response_code = 204 uri = /eip-gateways
27232024-11-14T09:06:05.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42186 req_id = 00fee0f8-82c7-48e5-838a-2921dbe2a069 response_code = 204 uri = /vpc-routes
27242024-11-14T09:06:05.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40018
27252024-11-14T09:06:05.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40018 req_id = db17d1c4-ed32-46d5-967f-2ffa7a455d47 response_code = 200 uri = /vpc-routes
27262024-11-14T09:06:05.665ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47405
27272024-11-14T09:06:05.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47405 req_id = 731bd036-5195-43d6-9ef9-2f09bce486be response_code = 200 uri = /v2p
27282024-11-14T09:06:05.697ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
27292024-11-14T09:06:05.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40018 req_id = cff4e7e7-ffd9-40f7-80f7-b3e6ff36fe86 response_code = 204 uri = /eip-gateways
27302024-11-14T09:06:05.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59597
27312024-11-14T09:06:05.738ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27322024-11-14T09:06:05.786ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27332024-11-14T09:06:05.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125005 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59597 req_id = d31877ed-6c6d-43e0-99cb-b55c163ce221 response_code = 204 uri = /switch-ports
27342024-11-14T09:06:05.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56771
27352024-11-14T09:06:05.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40018 req_id = 4e15af82-85df-4eac-9b8f-388da1c9759e response_code = 204 uri = /vpc-routes
27362024-11-14T09:06:05.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56771 req_id = 24c8df42-532e-41a2-b201-63ff408b6d98 response_code = 200 uri = /v2p
27372024-11-14T09:06:05.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59597 req_id = 8b906d3a-9719-48b1-a48c-9da758bc1514 response_code = 200 uri = /network-bootstore-config
27382024-11-14T09:06:05.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63757
27392024-11-14T09:06:05.893ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27402024-11-14T09:06:05.938ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27412024-11-14T09:06:06.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107999 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63757 req_id = 13882b3b-02c3-4e76-a51b-cc96b665dfee response_code = 204 uri = /switch-ports
27422024-11-14T09:06:06.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33112
27432024-11-14T09:06:06.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33112 req_id = 2bf90ee8-a300-4fec-a40c-def180d9d72b response_code = 200 uri = /vpc-routes
27442024-11-14T09:06:06.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63757 req_id = 5358ed81-0293-4d05-9e36-cb81ef2ccd88 response_code = 200 uri = /network-bootstore-config
27452024-11-14T09:06:06.026ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
27462024-11-14T09:06:06.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33112 req_id = 515cd0a8-8859-4526-9de3-0941099134a8 response_code = 204 uri = /eip-gateways
27472024-11-14T09:06:06.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33112 req_id = 9eb0a6e3-e572-4cdd-a736-b92adcc0b432 response_code = 204 uri = /vpc-routes
27482024-11-14T09:06:06.061ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61459
27492024-11-14T09:06:06.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61459 req_id = b63c0c17-cba6-41f0-b260-08f191be673b response_code = 200 uri = /v2p
27502024-11-14T09:06:06.106ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55527
27512024-11-14T09:06:06.107ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27522024-11-14T09:06:06.150ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27532024-11-14T09:06:06.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106917 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55527 req_id = f582a912-a418-46ae-8c82-765b389f28ae response_code = 204 uri = /switch-ports
27542024-11-14T09:06:06.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55527 req_id = 77f33d69-da31-4666-be73-21854d817089 response_code = 200 uri = /network-bootstore-config
27552024-11-14T09:06:07.968ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27562024-11-14T09:06:07.969ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27572024-11-14T09:06:12.486ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27582024-11-14T09:06:12.487ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27592024-11-14T09:06:12.487ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27602024-11-14T09:06:12.488ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27612024-11-14T09:06:12.489ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27622024-11-14T09:06:12.489ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27632024-11-14T09:06:12.490ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27642024-11-14T09:06:13.237ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27652024-11-14T09:06:13.238ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27662024-11-14T09:06:13.238ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27672024-11-14T09:06:13.239ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27682024-11-14T09:06:13.240ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27692024-11-14T09:06:13.241ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27702024-11-14T09:06:13.241ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27712024-11-14T09:06:13.242ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27722024-11-14T09:06:13.243ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27732024-11-14T09:06:17.972ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27742024-11-14T09:06:17.973ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27752024-11-14T09:06:22.489ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27762024-11-14T09:06:22.490ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27772024-11-14T09:06:22.491ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27782024-11-14T09:06:22.492ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27792024-11-14T09:06:22.492ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27802024-11-14T09:06:22.493ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27812024-11-14T09:06:22.494ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27822024-11-14T09:06:23.241ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27832024-11-14T09:06:23.241ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27842024-11-14T09:06:23.242ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27852024-11-14T09:06:23.243ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27862024-11-14T09:06:23.243ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27872024-11-14T09:06:23.244ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27882024-11-14T09:06:23.245ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27892024-11-14T09:06:23.245ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27902024-11-14T09:06:23.246ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27912024-11-14T09:06:23.672ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48437
27922024-11-14T09:06:23.672ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48437 req_id = 973ed72e-8fc5-4248-82b5-86cdddba5a29 response_code = 200 uri = /baseboard
27932024-11-14T09:06:27.977ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27942024-11-14T09:06:27.978ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27952024-11-14T09:06:32.492ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27962024-11-14T09:06:32.492ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27972024-11-14T09:06:32.493ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27982024-11-14T09:06:32.494ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
27992024-11-14T09:06:32.495ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28002024-11-14T09:06:32.496ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28012024-11-14T09:06:32.497ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28022024-11-14T09:06:33.246ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28032024-11-14T09:06:33.247ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28042024-11-14T09:06:33.248ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28052024-11-14T09:06:33.248ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28062024-11-14T09:06:33.249ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28072024-11-14T09:06:33.250ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28082024-11-14T09:06:33.251ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28092024-11-14T09:06:33.251ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28102024-11-14T09:06:33.252ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28112024-11-14T09:06:35.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63435
28122024-11-14T09:06:35.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63435 req_id = 08763446-22a6-43d8-89d7-8352180e7d10 response_code = 200 uri = /v2p
28132024-11-14T09:06:35.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34884
28142024-11-14T09:06:35.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34884 req_id = 76947c10-94b6-4a4d-bbb0-c35b3959f688 response_code = 200 uri = /vpc-routes
28152024-11-14T09:06:35.526ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
28162024-11-14T09:06:35.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34884 req_id = 89882809-2c68-4759-99d7-e009b7003afb response_code = 204 uri = /eip-gateways
28172024-11-14T09:06:35.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34884 req_id = 887f577a-7b81-4cbb-9574-ba8797ab8771 response_code = 204 uri = /vpc-routes
28182024-11-14T09:06:35.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54274
28192024-11-14T09:06:35.563ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28202024-11-14T09:06:35.622ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28212024-11-14T09:06:35.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144867 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54274 req_id = 22261ba5-577e-4521-a1f5-5f4b7093fe1a response_code = 204 uri = /switch-ports
28222024-11-14T09:06:35.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61155
28232024-11-14T09:06:35.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64995
28242024-11-14T09:06:35.708ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28252024-11-14T09:06:35.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61155 req_id = 5c99f2b1-0443-4727-9b53-3b8ac10c3e07 response_code = 200 uri = /vpc-routes
28262024-11-14T09:06:35.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54274 req_id = a9744806-eb64-41e2-9a09-175267907921 response_code = 200 uri = /network-bootstore-config
28272024-11-14T09:06:35.723ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
28282024-11-14T09:06:35.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61155 req_id = 3a93c7eb-f737-404b-8838-88075642b039 response_code = 204 uri = /eip-gateways
28292024-11-14T09:06:35.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61155 req_id = f45289a3-c371-46a1-b5e0-90422b213b69 response_code = 204 uri = /vpc-routes
28302024-11-14T09:06:35.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45268
28312024-11-14T09:06:35.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45268 req_id = 446a4404-7548-40e0-b9a8-adec5a16015a response_code = 200 uri = /vpc-routes
28322024-11-14T09:06:35.752ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28332024-11-14T09:06:35.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36172
28342024-11-14T09:06:35.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36172 req_id = a29b481c-2351-4607-addf-5ed6ac097c53 response_code = 200 uri = /v2p
28352024-11-14T09:06:35.781ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59765
28362024-11-14T09:06:35.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59765 req_id = 8cd1fdb7-9318-44ab-a6f2-ebb6f948041b response_code = 200 uri = /v2p
28372024-11-14T09:06:35.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106741 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64995 req_id = 31da409a-4951-4c44-8704-f02b1ae27113 response_code = 204 uri = /switch-ports
28382024-11-14T09:06:35.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64995 req_id = 250956cc-1040-40a2-876d-bc15dcbc60b6 response_code = 200 uri = /network-bootstore-config
28392024-11-14T09:06:35.820ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
28402024-11-14T09:06:35.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45268 req_id = 79621533-c298-46c8-9bf7-4daca3cf61a8 response_code = 204 uri = /eip-gateways
28412024-11-14T09:06:35.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45268 req_id = fb499154-5d8e-4e6d-90a6-cc12b62e78cd response_code = 204 uri = /vpc-routes
28422024-11-14T09:06:35.833ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62560
28432024-11-14T09:06:35.833ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28442024-11-14T09:06:35.870ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28452024-11-14T09:06:35.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94331 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62560 req_id = 8c10e274-67d7-4594-a662-2f9c709c215b response_code = 204 uri = /switch-ports
28462024-11-14T09:06:35.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62560 req_id = f222fe3f-3239-4d8a-a17f-eef233b08875 response_code = 200 uri = /network-bootstore-config
28472024-11-14T09:06:37.981ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28482024-11-14T09:06:37.982ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28492024-11-14T09:06:42.494ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28502024-11-14T09:06:42.494ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28512024-11-14T09:06:42.495ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28522024-11-14T09:06:42.496ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28532024-11-14T09:06:42.497ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28542024-11-14T09:06:42.498ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28552024-11-14T09:06:42.499ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28562024-11-14T09:06:43.249ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28572024-11-14T09:06:43.250ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28582024-11-14T09:06:43.250ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28592024-11-14T09:06:43.251ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28602024-11-14T09:06:43.251ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28612024-11-14T09:06:43.252ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28622024-11-14T09:06:43.253ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28632024-11-14T09:06:43.253ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28642024-11-14T09:06:43.254ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28652024-11-14T09:06:47.986ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28662024-11-14T09:06:47.986ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28672024-11-14T09:06:52.496ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28682024-11-14T09:06:52.497ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28692024-11-14T09:06:52.497ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28702024-11-14T09:06:52.498ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28712024-11-14T09:06:52.499ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28722024-11-14T09:06:52.500ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28732024-11-14T09:06:52.501ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28742024-11-14T09:06:53.253ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28752024-11-14T09:06:53.254ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28762024-11-14T09:06:53.254ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28772024-11-14T09:06:53.255ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28782024-11-14T09:06:53.256ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28792024-11-14T09:06:53.256ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28802024-11-14T09:06:53.257ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28812024-11-14T09:06:53.258ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28822024-11-14T09:06:53.258ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28832024-11-14T09:06:53.703ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63856
28842024-11-14T09:06:53.703ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63856 req_id = 7e9572f1-7cab-4a75-8607-2c41746ec1b8 response_code = 200 uri = /baseboard
28852024-11-14T09:06:57.990ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28862024-11-14T09:06:57.990ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28872024-11-14T09:07:02.499ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28882024-11-14T09:07:02.500ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28892024-11-14T09:07:02.500ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28902024-11-14T09:07:02.501ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28912024-11-14T09:07:02.502ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28922024-11-14T09:07:02.502ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28932024-11-14T09:07:02.503ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28942024-11-14T09:07:03.257ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28952024-11-14T09:07:03.258ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28962024-11-14T09:07:03.258ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28972024-11-14T09:07:03.259ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28982024-11-14T09:07:03.260ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
28992024-11-14T09:07:03.260ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29002024-11-14T09:07:03.261ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29012024-11-14T09:07:03.262ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29022024-11-14T09:07:03.262ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29032024-11-14T09:07:05.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45651
29042024-11-14T09:07:05.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45651 req_id = cefd1712-e4a5-467d-bb0e-a3f741f8a053 response_code = 200 uri = /vpc-routes
29052024-11-14T09:07:05.676ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
29062024-11-14T09:07:05.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45651 req_id = 38262f68-d32f-4298-90cb-870795c43ee2 response_code = 204 uri = /eip-gateways
29072024-11-14T09:07:05.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45651 req_id = a19fbfed-dba0-4c9e-af46-e35a33130dc3 response_code = 204 uri = /vpc-routes
29082024-11-14T09:07:05.749ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37943
29092024-11-14T09:07:05.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37943 req_id = f6ebbb34-d1aa-403b-97cf-6ef6789df69f response_code = 200 uri = /vpc-routes
29102024-11-14T09:07:05.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55340
29112024-11-14T09:07:05.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55340 req_id = 3b3bfe6c-474c-443a-b451-8e315af91d45 response_code = 200 uri = /v2p
29122024-11-14T09:07:05.768ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
29132024-11-14T09:07:05.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37943 req_id = 1bd3d419-5118-4e52-b381-023d2f27f010 response_code = 204 uri = /eip-gateways
29142024-11-14T09:07:05.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54811
29152024-11-14T09:07:05.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54811 req_id = 8b057b4d-bd07-4309-8eb5-b88e8a80c1b5 response_code = 200 uri = /v2p
29162024-11-14T09:07:05.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37943 req_id = d87eb77d-f903-4d73-aef1-72f5d97b31bc response_code = 204 uri = /vpc-routes
29172024-11-14T09:07:05.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62886
29182024-11-14T09:07:05.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62886 req_id = 028032eb-270d-4299-9c5a-a035320ee741 response_code = 200 uri = /vpc-routes
29192024-11-14T09:07:05.909ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
29202024-11-14T09:07:05.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62886 req_id = 8d2bc3b7-56b5-44e1-a5a1-4a73013f7c35 response_code = 204 uri = /eip-gateways
29212024-11-14T09:07:05.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62886 req_id = cf69d6ac-3aa2-4657-ad38-fa1b855620c9 response_code = 204 uri = /vpc-routes
29222024-11-14T09:07:05.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48657
29232024-11-14T09:07:05.921ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29242024-11-14T09:07:05.978ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29252024-11-14T09:07:06.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137259 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48657 req_id = b5bc8286-4646-49c7-b040-e965120475a4 response_code = 204 uri = /switch-ports
29262024-11-14T09:07:06.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39222
29272024-11-14T09:07:06.059ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29282024-11-14T09:07:06.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48657 req_id = 9d53c6e1-761a-434c-947f-709d63dbb10f response_code = 200 uri = /network-bootstore-config
29292024-11-14T09:07:06.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38307
29302024-11-14T09:07:06.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 405 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38307 req_id = 5610f3da-a233-46e5-9f4b-4767d306d32a response_code = 200 uri = /v2p
29312024-11-14T09:07:06.088ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56690
29322024-11-14T09:07:06.117ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29332024-11-14T09:07:06.204ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29342024-11-14T09:07:06.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145195 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39222 req_id = d36b9bf9-62d9-44b7-a8f3-634e5dd765d1 response_code = 204 uri = /switch-ports
29352024-11-14T09:07:06.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 513 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39222 req_id = b1d718ef-45c8-4188-8eed-7989fe0d5450 response_code = 200 uri = /network-bootstore-config
29362024-11-14T09:07:06.255ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29372024-11-14T09:07:06.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244798 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56690 req_id = f9558004-6031-4578-86c1-6bf5c91ea621 response_code = 204 uri = /switch-ports
29382024-11-14T09:07:06.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56690 req_id = db959883-8760-4149-9841-dac2b8ee86fc response_code = 200 uri = /network-bootstore-config
29392024-11-14T09:07:07.994ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29402024-11-14T09:07:07.994ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29412024-11-14T09:07:12.501ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29422024-11-14T09:07:12.501ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29432024-11-14T09:07:12.502ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29442024-11-14T09:07:12.503ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29452024-11-14T09:07:12.503ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29462024-11-14T09:07:12.504ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29472024-11-14T09:07:12.505ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29482024-11-14T09:07:13.261ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29492024-11-14T09:07:13.262ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29502024-11-14T09:07:13.263ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29512024-11-14T09:07:13.263ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29522024-11-14T09:07:13.264ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29532024-11-14T09:07:13.265ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29542024-11-14T09:07:13.265ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29552024-11-14T09:07:13.266ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29562024-11-14T09:07:13.267ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29572024-11-14T09:07:17.998ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29582024-11-14T09:07:17.999ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29592024-11-14T09:07:22.503ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29602024-11-14T09:07:22.504ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29612024-11-14T09:07:22.504ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29622024-11-14T09:07:22.505ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29632024-11-14T09:07:22.506ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29642024-11-14T09:07:22.506ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29652024-11-14T09:07:22.507ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29662024-11-14T09:07:23.265ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29672024-11-14T09:07:23.265ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29682024-11-14T09:07:23.266ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29692024-11-14T09:07:23.266ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29702024-11-14T09:07:23.267ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29712024-11-14T09:07:23.267ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29722024-11-14T09:07:23.268ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29732024-11-14T09:07:23.268ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29742024-11-14T09:07:23.269ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29752024-11-14T09:07:23.737ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56467
29762024-11-14T09:07:23.737ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56467 req_id = 3466426b-72ca-4626-a586-07f68a910c99 response_code = 200 uri = /baseboard
29772024-11-14T09:07:28.002ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29782024-11-14T09:07:28.003ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29792024-11-14T09:07:32.505ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29802024-11-14T09:07:32.506ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29812024-11-14T09:07:32.507ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29822024-11-14T09:07:32.514ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29832024-11-14T09:07:32.515ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29842024-11-14T09:07:32.516ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29852024-11-14T09:07:32.517ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29862024-11-14T09:07:33.268ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29872024-11-14T09:07:33.269ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29882024-11-14T09:07:33.269ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29892024-11-14T09:07:33.270ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29902024-11-14T09:07:33.271ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29912024-11-14T09:07:33.271ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29922024-11-14T09:07:33.272ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29932024-11-14T09:07:33.273ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29942024-11-14T09:07:33.273ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
29952024-11-14T09:07:35.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64045
29962024-11-14T09:07:35.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64045 req_id = 6838000e-9228-459d-b706-da1cab089d89 response_code = 200 uri = /vpc-routes
29972024-11-14T09:07:35.471ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
29982024-11-14T09:07:35.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64045 req_id = a67e8de3-e42d-44fe-bb29-f0433dc986ac response_code = 204 uri = /eip-gateways
29992024-11-14T09:07:35.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64045 req_id = 2f08e4ea-110f-4c71-b396-545845dac12c response_code = 204 uri = /vpc-routes
30002024-11-14T09:07:35.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52133
30012024-11-14T09:07:35.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52133 req_id = 070facdb-1c99-402a-96e2-0d417496c78e response_code = 200 uri = /v2p
30022024-11-14T09:07:35.597ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51077
30032024-11-14T09:07:35.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51077 req_id = 6b49ac7a-981c-477c-92fb-b607427515aa response_code = 200 uri = /vpc-routes
30042024-11-14T09:07:35.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60394
30052024-11-14T09:07:35.635ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30062024-11-14T09:07:35.687ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30072024-11-14T09:07:35.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118601 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60394 req_id = a2e68dfb-09ce-4a32-9432-63665c987ba0 response_code = 204 uri = /switch-ports
30082024-11-14T09:07:35.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35452
30092024-11-14T09:07:35.754ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
30102024-11-14T09:07:35.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51077 req_id = bd67378d-67b5-42d3-a042-0b12b3e5580c response_code = 204 uri = /eip-gateways
30112024-11-14T09:07:35.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35452 req_id = 949a47c3-81fe-4c7a-8205-4eb00b393acb response_code = 200 uri = /vpc-routes
30122024-11-14T09:07:35.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60394 req_id = 652c1cc4-2549-4e65-bfcc-adf107ee7e17 response_code = 200 uri = /network-bootstore-config
30132024-11-14T09:07:35.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2790 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51077 req_id = 34a449ec-3896-44da-b6fc-b9546f283e99 response_code = 204 uri = /vpc-routes
30142024-11-14T09:07:35.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62924
30152024-11-14T09:07:35.767ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30162024-11-14T09:07:35.808ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30172024-11-14T09:07:35.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103981 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62924 req_id = 3a4d8a0e-9ab0-4534-b44f-6db4e971ddf4 response_code = 204 uri = /switch-ports
30182024-11-14T09:07:35.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41316
30192024-11-14T09:07:35.871ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
30202024-11-14T09:07:35.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62924 req_id = 926de5e8-a9c5-4bb1-90c4-2c887ca5a86d response_code = 200 uri = /network-bootstore-config
30212024-11-14T09:07:35.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35452 req_id = 56175f1f-f7f6-4dea-990a-a9759f6989d2 response_code = 204 uri = /eip-gateways
30222024-11-14T09:07:35.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41316 req_id = ee91e1bd-1545-415f-9620-5cfbe963b413 response_code = 200 uri = /v2p
30232024-11-14T09:07:35.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35452 req_id = 41041445-f17a-4b52-8216-d13333d14e32 response_code = 204 uri = /vpc-routes
30242024-11-14T09:07:35.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50325
30252024-11-14T09:07:35.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50325 req_id = 23d4e7e6-18e6-4dee-9e99-9d3dadeae1fa response_code = 200 uri = /v2p
30262024-11-14T09:07:35.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40012
30272024-11-14T09:07:35.914ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30282024-11-14T09:07:35.954ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30292024-11-14T09:07:36.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99643 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40012 req_id = b1f470f2-8c06-491e-8dcb-e66c9d6b3a53 response_code = 204 uri = /switch-ports
30302024-11-14T09:07:36.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40012 req_id = caf7b01a-b346-4208-915d-118c41515100 response_code = 200 uri = /network-bootstore-config
30312024-11-14T09:07:38.006ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30322024-11-14T09:07:38.007ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30332024-11-14T09:07:42.507ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30342024-11-14T09:07:42.508ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30352024-11-14T09:07:42.508ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30362024-11-14T09:07:42.516ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30372024-11-14T09:07:42.517ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30382024-11-14T09:07:42.518ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30392024-11-14T09:07:42.518ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30402024-11-14T09:07:43.272ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30412024-11-14T09:07:43.273ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30422024-11-14T09:07:43.273ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30432024-11-14T09:07:43.274ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30442024-11-14T09:07:43.275ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30452024-11-14T09:07:43.276ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30462024-11-14T09:07:43.276ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30472024-11-14T09:07:43.277ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30482024-11-14T09:07:43.278ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30492024-11-14T09:07:48.010ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30502024-11-14T09:07:48.011ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30512024-11-14T09:07:52.510ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30522024-11-14T09:07:52.510ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30532024-11-14T09:07:52.511ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30542024-11-14T09:07:52.518ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30552024-11-14T09:07:52.519ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30562024-11-14T09:07:52.520ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30572024-11-14T09:07:52.521ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30582024-11-14T09:07:53.276ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30592024-11-14T09:07:53.276ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30602024-11-14T09:07:53.277ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30612024-11-14T09:07:53.278ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30622024-11-14T09:07:53.279ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30632024-11-14T09:07:53.279ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30642024-11-14T09:07:53.280ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30652024-11-14T09:07:53.281ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30662024-11-14T09:07:53.281ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30672024-11-14T09:07:53.770ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43502
30682024-11-14T09:07:53.770ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43502 req_id = 8743ffd2-c74b-4c33-8ab3-f39728012e2b response_code = 200 uri = /baseboard
30692024-11-14T09:07:58.014ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30702024-11-14T09:07:58.015ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30712024-11-14T09:08:02.511ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30722024-11-14T09:08:02.512ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30732024-11-14T09:08:02.513ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30742024-11-14T09:08:02.519ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30752024-11-14T09:08:02.520ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30762024-11-14T09:08:02.522ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30772024-11-14T09:08:02.523ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30782024-11-14T09:08:03.280ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30792024-11-14T09:08:03.281ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30802024-11-14T09:08:03.282ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30812024-11-14T09:08:03.282ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30822024-11-14T09:08:03.283ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30832024-11-14T09:08:03.284ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30842024-11-14T09:08:03.284ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30852024-11-14T09:08:03.285ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30862024-11-14T09:08:03.286ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
30872024-11-14T09:08:05.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54465
30882024-11-14T09:08:05.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54465 req_id = 0d24c558-6e52-4b3a-9e9a-2bd46abeaf62 response_code = 200 uri = /vpc-routes
30892024-11-14T09:08:05.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50632
30902024-11-14T09:08:05.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50632 req_id = 3c259fec-dda7-40f3-a50a-95e316a65490 response_code = 200 uri = /vpc-routes
30912024-11-14T09:08:05.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41345
30922024-11-14T09:08:05.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41345 req_id = 23885090-8492-42fd-a59f-5d060af18766 response_code = 200 uri = /vpc-routes
30932024-11-14T09:08:05.805ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
30942024-11-14T09:08:05.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41345 req_id = 01cf51b1-330b-4815-984b-c570cb8bcc10 response_code = 204 uri = /eip-gateways
30952024-11-14T09:08:05.818ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
30962024-11-14T09:08:05.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54465 req_id = 246788db-cc42-4aec-9b7d-a0f49ed9f6ac response_code = 204 uri = /eip-gateways
30972024-11-14T09:08:05.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54465 req_id = 8d7ca996-1ea9-4484-8086-35f7aa514c22 response_code = 204 uri = /vpc-routes
30982024-11-14T09:08:05.837ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
30992024-11-14T09:08:05.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50632 req_id = ba2b259e-cc75-4cdd-8e72-95b2154428f2 response_code = 204 uri = /eip-gateways
31002024-11-14T09:08:05.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42536
31012024-11-14T09:08:05.879ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
31022024-11-14T09:08:05.879ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
31032024-11-14T09:08:05.879ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/omicron-zones.json file = common/src/ledger.rs:177
31042024-11-14T09:08:05.880ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/omicron-zones.json file = common/src/ledger.rs:177
31052024-11-14T09:08:05.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59934
31062024-11-14T09:08:05.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59934 req_id = f0d27176-7cd7-45c6-a088-442cf00316d5 response_code = 200 uri = /v2p
31072024-11-14T09:08:05.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41345 req_id = 4351b1d6-3209-4aaf-843d-5e386b2d7c78 response_code = 204 uri = /vpc-routes
31082024-11-14T09:08:05.896ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
31092024-11-14T09:08:05.896ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_371f3005-927c-4e65-88a0-18072469758d
31102024-11-14T09:08:05.925ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
31112024-11-14T09:08:05.925ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_adf8829f-c3eb-4450-b693-c7220506810c
31122024-11-14T09:08:05.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52012
31132024-11-14T09:08:05.944ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
31142024-11-14T09:08:05.944ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
31152024-11-14T09:08:05.944ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/omicron-zones.json file = common/src/ledger.rs:177
31162024-11-14T09:08:05.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55836
31172024-11-14T09:08:05.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1091 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50632 req_id = c265421f-b56d-46e2-b63d-02ff8b43bf03 response_code = 204 uri = /vpc-routes
31182024-11-14T09:08:05.953ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/omicron-zones.json file = common/src/ledger.rs:177
31192024-11-14T09:08:05.953ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
31202024-11-14T09:08:05.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49092
31212024-11-14T09:08:05.962ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31222024-11-14T09:08:05.968ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
31232024-11-14T09:08:05.968ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7d1e429d-74f9-4a0f-9382-4b993f07db56
31242024-11-14T09:08:05.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50138
31252024-11-14T09:08:05.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50138 req_id = e991681b-e95c-4c6b-9f84-e1a232ad5738 response_code = 200 uri = /v2p
31262024-11-14T09:08:05.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43713
31272024-11-14T09:08:05.991ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
31282024-11-14T09:08:05.991ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_371f3005-927c-4e65-88a0-18072469758d
31292024-11-14T09:08:06.010ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
31302024-11-14T09:08:06.010ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/config/omicron-zones.json file = common/src/ledger.rs:177
31312024-11-14T09:08:06.016ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31322024-11-14T09:08:06.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60435
31332024-11-14T09:08:06.029ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
31342024-11-14T09:08:06.030ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_493c27e1-df39-477b-8315-ad9aa5767668
31352024-11-14T09:08:06.037ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/config/omicron-zones.json file = common/src/ledger.rs:177
31362024-11-14T09:08:06.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54597
31372024-11-14T09:08:06.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35975
31382024-11-14T09:08:06.043ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 208292a9-20b7-485e-95b8-8fa301192abc, kind: Service { id: ef32bdd5-939a-4ab0-a70a-6f004e97691b }, name: Name("external-dns-ef32bdd5-939a-4ab0-a70a-6f004e97691b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 49])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7b6a42b1-a060-4782-a598-da956f0e54bf, kind: Service { id: e0fbd02e-9643-47c5-9261-dd03abc268a8 }, name: Name("external-dns-e0fbd02e-9643-47c5-9261-dd03abc268a8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3d08f9bf-1395-4918-83ef-e9bf23bb54cc, kind: Service { id: d3dd4036-6839-48d6-8f36-e642d9b3e6c0 }, name: Name("nexus-d3dd4036-6839-48d6-8f36-e642d9b3e6c0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 97])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eb09bf8b-0a0a-43d0-8fab-de971f1991ea, kind: Service { id: b933d23e-28f4-4f5e-9ad9-9694702ed335 }, name: Name("nexus-b933d23e-28f4-4f5e-9ad9-9694702ed335"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f73311b5-bba3-40b6-b24a-8c3229a71a49, kind: Service { id: 484a1c50-302f-49ec-9214-2179c2ff7104 }, name: Name("nexus-484a1c50-302f-49ec-9214-2179c2ff7104"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
31392024-11-14T09:08:06.043ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
31402024-11-14T09:08:06.052ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
31412024-11-14T09:08:06.052ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
31422024-11-14T09:08:06.052ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
31432024-11-14T09:08:06.052ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
31442024-11-14T09:08:06.052ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
31452024-11-14T09:08:06.052ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
31462024-11-14T09:08:06.052ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_adf8829f-c3eb-4450-b693-c7220506810c
31472024-11-14T09:08:06.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54597 req_id = fc769c64-88a2-47ab-84ed-945efde8e91b response_code = 200 uri = /v2p
31482024-11-14T09:08:06.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21038 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60435 req_id = cfad0b92-26fc-4399-ba2e-af7693547f9f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
31492024-11-14T09:08:06.069ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 371f3005-927c-4e65-88a0-18072469758d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
31502024-11-14T09:08:06.070ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_371f3005-927c-4e65-88a0-18072469758d
31512024-11-14T09:08:06.092ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
31522024-11-14T09:08:06.095ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ef6848de-2e18-4d49-825f-a08523c761f3
31532024-11-14T09:08:06.114ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: adf8829f-c3eb-4450-b693-c7220506810c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
31542024-11-14T09:08:06.114ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_adf8829f-c3eb-4450-b693-c7220506810c
31552024-11-14T09:08:06.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34521
31562024-11-14T09:08:06.124ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31572024-11-14T09:08:06.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161744 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49092 req_id = 44fa0538-8c79-45a8-bef3-9c71ee517c90 response_code = 204 uri = /switch-ports
31582024-11-14T09:08:06.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 790 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49092 req_id = 7486718f-77c0-4998-8b91-eeccce256b29 response_code = 200 uri = /network-bootstore-config
31592024-11-14T09:08:06.130ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 208292a9-20b7-485e-95b8-8fa301192abc, kind: Service { id: ef32bdd5-939a-4ab0-a70a-6f004e97691b }, name: Name("external-dns-ef32bdd5-939a-4ab0-a70a-6f004e97691b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 49])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7b6a42b1-a060-4782-a598-da956f0e54bf, kind: Service { id: e0fbd02e-9643-47c5-9261-dd03abc268a8 }, name: Name("external-dns-e0fbd02e-9643-47c5-9261-dd03abc268a8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3d08f9bf-1395-4918-83ef-e9bf23bb54cc, kind: Service { id: d3dd4036-6839-48d6-8f36-e642d9b3e6c0 }, name: Name("nexus-d3dd4036-6839-48d6-8f36-e642d9b3e6c0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 97])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eb09bf8b-0a0a-43d0-8fab-de971f1991ea, kind: Service { id: b933d23e-28f4-4f5e-9ad9-9694702ed335 }, name: Name("nexus-b933d23e-28f4-4f5e-9ad9-9694702ed335"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f73311b5-bba3-40b6-b24a-8c3229a71a49, kind: Service { id: 484a1c50-302f-49ec-9214-2179c2ff7104 }, name: Name("nexus-484a1c50-302f-49ec-9214-2179c2ff7104"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
31602024-11-14T09:08:06.130ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
31612024-11-14T09:08:06.130ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
31622024-11-14T09:08:06.131ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
31632024-11-14T09:08:06.131ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
31642024-11-14T09:08:06.131ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
31652024-11-14T09:08:06.131ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
31662024-11-14T09:08:06.131ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7d1e429d-74f9-4a0f-9382-4b993f07db56
31672024-11-14T09:08:06.131ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
31682024-11-14T09:08:06.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11660 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34521 req_id = e0165d87-671c-4e0b-a639-9f1245b0cea8 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
31692024-11-14T09:08:06.151ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6032d020-e97f-4442-878e-bcdbe3293876 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
31702024-11-14T09:08:06.152ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_6032d020-e97f-4442-878e-bcdbe3293876
31712024-11-14T09:08:06.168ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
31722024-11-14T09:08:06.168ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_493c27e1-df39-477b-8315-ad9aa5767668
31732024-11-14T09:08:06.173ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31742024-11-14T09:08:06.190ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7d1e429d-74f9-4a0f-9382-4b993f07db56 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
31752024-11-14T09:08:06.190ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7d1e429d-74f9-4a0f-9382-4b993f07db56
31762024-11-14T09:08:06.208ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8a4b1a2c-0585-4f12-8c9a-b7cf61af774a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
31772024-11-14T09:08:06.213ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8a4b1a2c-0585-4f12-8c9a-b7cf61af774a
31782024-11-14T09:08:06.233ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 493c27e1-df39-477b-8315-ad9aa5767668 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
31792024-11-14T09:08:06.233ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_493c27e1-df39-477b-8315-ad9aa5767668
31802024-11-14T09:08:06.247ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
31812024-11-14T09:08:06.247ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ef6848de-2e18-4d49-825f-a08523c761f3
31822024-11-14T09:08:06.252ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31832024-11-14T09:08:06.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261756 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43713 req_id = e811a459-1436-4628-8618-e729327e7cb3 response_code = 204 uri = /switch-ports
31842024-11-14T09:08:06.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6042 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43713 req_id = 706218f4-86c1-43b3-a337-beecfe9f10e0 response_code = 200 uri = /network-bootstore-config
31852024-11-14T09:08:06.274ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
31862024-11-14T09:08:06.274ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d752d0db-efe8-492a-8a25-a56ee29e644b
31872024-11-14T09:08:06.291ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6032d020-e97f-4442-878e-bcdbe3293876 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
31882024-11-14T09:08:06.291ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_6032d020-e97f-4442-878e-bcdbe3293876
31892024-11-14T09:08:06.307ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ef6848de-2e18-4d49-825f-a08523c761f3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
31902024-11-14T09:08:06.308ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ef6848de-2e18-4d49-825f-a08523c761f3
31912024-11-14T09:08:06.312ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31922024-11-14T09:08:06.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63046
31932024-11-14T09:08:06.328ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 208292a9-20b7-485e-95b8-8fa301192abc, kind: Service { id: ef32bdd5-939a-4ab0-a70a-6f004e97691b }, name: Name("external-dns-ef32bdd5-939a-4ab0-a70a-6f004e97691b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 49])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7b6a42b1-a060-4782-a598-da956f0e54bf, kind: Service { id: e0fbd02e-9643-47c5-9261-dd03abc268a8 }, name: Name("external-dns-e0fbd02e-9643-47c5-9261-dd03abc268a8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3d08f9bf-1395-4918-83ef-e9bf23bb54cc, kind: Service { id: d3dd4036-6839-48d6-8f36-e642d9b3e6c0 }, name: Name("nexus-d3dd4036-6839-48d6-8f36-e642d9b3e6c0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 97])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eb09bf8b-0a0a-43d0-8fab-de971f1991ea, kind: Service { id: b933d23e-28f4-4f5e-9ad9-9694702ed335 }, name: Name("nexus-b933d23e-28f4-4f5e-9ad9-9694702ed335"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f73311b5-bba3-40b6-b24a-8c3229a71a49, kind: Service { id: 484a1c50-302f-49ec-9214-2179c2ff7104 }, name: Name("nexus-484a1c50-302f-49ec-9214-2179c2ff7104"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
31942024-11-14T09:08:06.328ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
31952024-11-14T09:08:06.328ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
31962024-11-14T09:08:06.328ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
31972024-11-14T09:08:06.328ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
31982024-11-14T09:08:06.328ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
31992024-11-14T09:08:06.332ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
32002024-11-14T09:08:06.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4664 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63046 req_id = 369ad8d0-9ae1-421d-a68e-3badf338366a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
32012024-11-14T09:08:06.334ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
32022024-11-14T09:08:06.334ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7
32032024-11-14T09:08:06.356ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8a4b1a2c-0585-4f12-8c9a-b7cf61af774a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
32042024-11-14T09:08:06.356ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8a4b1a2c-0585-4f12-8c9a-b7cf61af774a
32052024-11-14T09:08:06.374ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6032d020-e97f-4442-878e-bcdbe3293876 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
32062024-11-14T09:08:06.374ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_6032d020-e97f-4442-878e-bcdbe3293876
32072024-11-14T09:08:06.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 506247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42536 req_id = 9d523a00-3b88-4f99-b340-0338d0cb886c response_code = 200 uri = /inventory
32082024-11-14T09:08:06.390ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
32092024-11-14T09:08:06.390ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d752d0db-efe8-492a-8a25-a56ee29e644b
32102024-11-14T09:08:06.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 357294 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35975 req_id = 91ae510f-2bfd-4a20-bfef-b664d535b3ac response_code = 204 uri = /switch-ports
32112024-11-14T09:08:06.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35975 req_id = 67776387-9b7d-41d3-945e-47c2f5997d3f response_code = 200 uri = /network-bootstore-config
32122024-11-14T09:08:06.418ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
32132024-11-14T09:08:06.418ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7
32142024-11-14T09:08:06.432ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8a4b1a2c-0585-4f12-8c9a-b7cf61af774a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
32152024-11-14T09:08:06.432ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8a4b1a2c-0585-4f12-8c9a-b7cf61af774a
32162024-11-14T09:08:06.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 508030 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52012 req_id = 8f747875-587d-4bc6-9df6-15bc569a5526 response_code = 200 uri = /inventory
32172024-11-14T09:08:06.459ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d752d0db-efe8-492a-8a25-a56ee29e644b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
32182024-11-14T09:08:06.459ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d752d0db-efe8-492a-8a25-a56ee29e644b
32192024-11-14T09:08:06.486ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
32202024-11-14T09:08:06.486ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7
32212024-11-14T09:08:06.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 546720 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55836 req_id = 4e69397a-ffbf-478d-b7ba-e58fb4658ee4 response_code = 200 uri = /inventory
32222024-11-14T09:08:08.019ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32232024-11-14T09:08:08.019ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32242024-11-14T09:08:12.514ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32252024-11-14T09:08:12.515ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32262024-11-14T09:08:12.515ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32272024-11-14T09:08:12.521ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32282024-11-14T09:08:12.522ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32292024-11-14T09:08:12.524ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32302024-11-14T09:08:12.525ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32312024-11-14T09:08:13.283ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32322024-11-14T09:08:13.284ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32332024-11-14T09:08:13.284ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32342024-11-14T09:08:13.285ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32352024-11-14T09:08:13.285ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32362024-11-14T09:08:13.286ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32372024-11-14T09:08:13.286ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32382024-11-14T09:08:13.287ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32392024-11-14T09:08:13.287ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32402024-11-14T09:08:18.023ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32412024-11-14T09:08:18.024ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32422024-11-14T09:08:22.516ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32432024-11-14T09:08:22.516ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32442024-11-14T09:08:22.517ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32452024-11-14T09:08:22.524ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32462024-11-14T09:08:22.524ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32472024-11-14T09:08:22.526ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32482024-11-14T09:08:22.527ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32492024-11-14T09:08:23.287ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32502024-11-14T09:08:23.287ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32512024-11-14T09:08:23.288ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32522024-11-14T09:08:23.289ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32532024-11-14T09:08:23.289ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32542024-11-14T09:08:23.290ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32552024-11-14T09:08:23.291ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32562024-11-14T09:08:23.291ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32572024-11-14T09:08:23.292ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32582024-11-14T09:08:23.802ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33353
32592024-11-14T09:08:23.802ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33353 req_id = d4931649-8e64-48ff-8ace-60e80b15b2c0 response_code = 200 uri = /baseboard
32602024-11-14T09:08:28.027ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32612024-11-14T09:08:28.027ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32622024-11-14T09:08:32.518ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32632024-11-14T09:08:32.519ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32642024-11-14T09:08:32.520ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32652024-11-14T09:08:32.526ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32662024-11-14T09:08:32.527ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32672024-11-14T09:08:32.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32682024-11-14T09:08:32.529ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32692024-11-14T09:08:33.290ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32702024-11-14T09:08:33.291ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32712024-11-14T09:08:33.291ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32722024-11-14T09:08:33.292ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32732024-11-14T09:08:33.293ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32742024-11-14T09:08:33.293ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32752024-11-14T09:08:33.294ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32762024-11-14T09:08:33.295ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32772024-11-14T09:08:33.295ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
32782024-11-14T09:08:35.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63470
32792024-11-14T09:08:35.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63470 req_id = 1f2269a0-1df1-4a05-a5d7-883fab84a748 response_code = 200 uri = /vpc-routes
32802024-11-14T09:08:35.489ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
32812024-11-14T09:08:35.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63470 req_id = 5d9f3830-7067-4782-963b-26158fff4e57 response_code = 204 uri = /eip-gateways
32822024-11-14T09:08:35.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63470 req_id = 1a78e800-e7b6-400b-8408-06afd6f24ed4 response_code = 204 uri = /vpc-routes
32832024-11-14T09:08:35.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35043
32842024-11-14T09:08:35.607ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32852024-11-14T09:08:35.661ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32862024-11-14T09:08:35.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126109 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35043 req_id = 18a0e8c6-2a7a-4493-ba06-eb0239ead4aa response_code = 204 uri = /switch-ports
32872024-11-14T09:08:35.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35510
32882024-11-14T09:08:35.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60318
32892024-11-14T09:08:35.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45063
32902024-11-14T09:08:35.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58268
32912024-11-14T09:08:35.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35043 req_id = c502c1a6-8a0d-4167-ac1a-d6087e140950 response_code = 200 uri = /network-bootstore-config
32922024-11-14T09:08:35.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35510 req_id = 1f9c9909-3827-4bd5-b4bf-f91c0dc2524b response_code = 200 uri = /vpc-routes
32932024-11-14T09:08:35.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 345 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60318 req_id = 93880e69-0c0e-40e6-895c-a4cbeae48d9f response_code = 200 uri = /v2p
32942024-11-14T09:08:35.734ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32952024-11-14T09:08:35.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45063 req_id = 7840d136-4015-490a-b045-64be8467ed5c response_code = 200 uri = /v2p
32962024-11-14T09:08:35.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47780
32972024-11-14T09:08:35.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47780 req_id = f76b216a-e18d-46a1-ba07-26703bb7c4aa response_code = 200 uri = /v2p
32982024-11-14T09:08:35.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46236
32992024-11-14T09:08:35.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46236 req_id = 10f543c9-3a1e-4358-abb8-bb1509b6c934 response_code = 200 uri = /vpc-routes
33002024-11-14T09:08:35.777ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
33012024-11-14T09:08:35.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35510 req_id = 25842bda-6aa3-4083-91f8-e6bfc855251c response_code = 204 uri = /eip-gateways
33022024-11-14T09:08:35.778ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
33032024-11-14T09:08:35.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35510 req_id = aea4413c-3094-44ba-a2f1-dc9b8e2a29a4 response_code = 204 uri = /vpc-routes
33042024-11-14T09:08:35.801ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
33052024-11-14T09:08:35.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46236 req_id = 482e08eb-cd07-4137-9d6c-9e0eba018744 response_code = 204 uri = /eip-gateways
33062024-11-14T09:08:35.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 828 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46236 req_id = 3fccde95-e249-4afa-923c-d9536d539d94 response_code = 204 uri = /vpc-routes
33072024-11-14T09:08:35.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49485
33082024-11-14T09:08:35.846ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
33092024-11-14T09:08:35.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112305 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58268 req_id = a378458e-08f1-4163-b6b3-4f32a5d975b4 response_code = 204 uri = /switch-ports
33102024-11-14T09:08:35.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 784 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58268 req_id = 929339f1-d819-4508-8994-45daf2d18f89 response_code = 200 uri = /network-bootstore-config
33112024-11-14T09:08:35.886ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
33122024-11-14T09:08:35.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118609 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49485 req_id = 764a076f-b431-4023-8d66-6fd397a9c8fe response_code = 204 uri = /switch-ports
33132024-11-14T09:08:35.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49485 req_id = 0816a1cc-1055-430d-befa-c9aef1e3c872 response_code = 200 uri = /network-bootstore-config
33142024-11-14T09:08:38.031ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33152024-11-14T09:08:38.032ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33162024-11-14T09:08:42.521ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33172024-11-14T09:08:42.522ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33182024-11-14T09:08:42.523ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33192024-11-14T09:08:42.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33202024-11-14T09:08:42.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33212024-11-14T09:08:42.530ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33222024-11-14T09:08:42.531ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33232024-11-14T09:08:43.293ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33242024-11-14T09:08:43.294ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33252024-11-14T09:08:43.295ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33262024-11-14T09:08:43.295ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33272024-11-14T09:08:43.296ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33282024-11-14T09:08:43.297ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33292024-11-14T09:08:43.297ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33302024-11-14T09:08:43.298ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33312024-11-14T09:08:43.298ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33322024-11-14T09:08:48.036ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33332024-11-14T09:08:48.037ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33342024-11-14T09:08:52.524ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33352024-11-14T09:08:52.525ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33362024-11-14T09:08:52.526ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33372024-11-14T09:08:52.530ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33382024-11-14T09:08:52.530ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33392024-11-14T09:08:52.531ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33402024-11-14T09:08:52.533ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33412024-11-14T09:08:53.297ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33422024-11-14T09:08:53.298ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33432024-11-14T09:08:53.298ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33442024-11-14T09:08:53.299ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33452024-11-14T09:08:53.299ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33462024-11-14T09:08:53.300ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33472024-11-14T09:08:53.300ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33482024-11-14T09:08:53.301ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33492024-11-14T09:08:53.301ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33502024-11-14T09:08:53.836ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57086
33512024-11-14T09:08:53.836ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57086 req_id = a6b18245-67fd-4034-b437-ec3a845e63fb response_code = 200 uri = /baseboard
33522024-11-14T09:08:58.040ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33532024-11-14T09:08:58.041ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33542024-11-14T09:09:02.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33552024-11-14T09:09:02.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33562024-11-14T09:09:02.529ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33572024-11-14T09:09:02.532ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33582024-11-14T09:09:02.533ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33592024-11-14T09:09:02.534ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33602024-11-14T09:09:02.534ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33612024-11-14T09:09:03.302ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33622024-11-14T09:09:03.303ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33632024-11-14T09:09:03.304ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33642024-11-14T09:09:03.304ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33652024-11-14T09:09:03.305ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33662024-11-14T09:09:03.306ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33672024-11-14T09:09:03.306ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33682024-11-14T09:09:03.307ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33692024-11-14T09:09:03.307ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
33702024-11-14T09:09:05.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38381
33712024-11-14T09:09:05.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38381 req_id = 72f802c9-7f64-4d60-8704-48dd153c6d4f response_code = 200 uri = /vpc-routes
33722024-11-14T09:09:05.635ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
33732024-11-14T09:09:05.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38381 req_id = 6692329c-7f15-4bc2-9e5e-cdbe58cc9ff0 response_code = 204 uri = /eip-gateways
33742024-11-14T09:09:05.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38381 req_id = d9b19a71-58d8-4367-acc0-aafdc850b180 response_code = 204 uri = /vpc-routes
33752024-11-14T09:09:05.698ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40164
33762024-11-14T09:09:05.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40164 req_id = d5efe23e-1231-4f03-aa8d-cad315c4c41f response_code = 200 uri = /vpc-routes
33772024-11-14T09:09:05.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36035
33782024-11-14T09:09:05.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36035 req_id = b17e494d-c478-4910-8f4e-a9480d9be871 response_code = 200 uri = /v2p
33792024-11-14T09:09:05.726ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
33802024-11-14T09:09:05.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40164 req_id = 0b8a37c2-1729-459c-988a-7918afb267a0 response_code = 204 uri = /eip-gateways
33812024-11-14T09:09:05.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40164 req_id = b1c677bc-4621-4d0b-a562-2b4da7410354 response_code = 204 uri = /vpc-routes
33822024-11-14T09:09:05.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58263
33832024-11-14T09:09:05.786ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
33842024-11-14T09:09:05.833ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
33852024-11-14T09:09:05.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111734 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58263 req_id = b76767d1-ac89-48f5-8d4c-741575b32b9b response_code = 204 uri = /switch-ports
33862024-11-14T09:09:05.898ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56371
33872024-11-14T09:09:05.898ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64057
33882024-11-14T09:09:05.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64057 req_id = 374ff032-bae8-41c4-85bc-a0e5fb8a82ed response_code = 200 uri = /v2p
33892024-11-14T09:09:05.898ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
33902024-11-14T09:09:05.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4716 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58263 req_id = e977cf04-74c5-427c-baa6-8fdb6c2a35de response_code = 200 uri = /network-bootstore-config
33912024-11-14T09:09:05.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65384
33922024-11-14T09:09:05.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65384 req_id = a67cc7de-ccc3-45b4-931b-80797d2d8a50 response_code = 200 uri = /vpc-routes
33932024-11-14T09:09:05.944ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
33942024-11-14T09:09:05.988ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
33952024-11-14T09:09:05.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 701 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65384 req_id = 6d66e537-f2c4-422a-a69c-8902080eedc3 response_code = 204 uri = /eip-gateways
33962024-11-14T09:09:06.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7325 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65384 req_id = 62d17dfb-412e-4779-b6d1-bc79c532c028 response_code = 204 uri = /vpc-routes
33972024-11-14T09:09:06.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134112 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56371 req_id = ad34bd71-6aa3-423c-b232-1ea5390be0a9 response_code = 204 uri = /switch-ports
33982024-11-14T09:09:06.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56371 req_id = ac24cff0-898e-4401-98cd-82741b257d40 response_code = 200 uri = /network-bootstore-config
33992024-11-14T09:09:06.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36427
34002024-11-14T09:09:06.171ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
34012024-11-14T09:09:06.215ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
34022024-11-14T09:09:06.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111277 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36427 req_id = 74dd85ec-d3c0-4fe4-be12-8a5b57be4ca3 response_code = 204 uri = /switch-ports
34032024-11-14T09:09:06.283ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59184
34042024-11-14T09:09:06.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36427 req_id = ee46fc45-fd92-4a2d-951b-690508077229 response_code = 200 uri = /network-bootstore-config
34052024-11-14T09:09:06.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59184 req_id = bea51be7-6fe6-48d2-80b7-a13dfc2c8c23 response_code = 200 uri = /v2p
34062024-11-14T09:09:08.044ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34072024-11-14T09:09:08.045ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34082024-11-14T09:09:12.531ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34092024-11-14T09:09:12.532ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34102024-11-14T09:09:12.533ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34112024-11-14T09:09:12.533ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34122024-11-14T09:09:12.535ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34132024-11-14T09:09:12.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34142024-11-14T09:09:12.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34152024-11-14T09:09:13.305ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34162024-11-14T09:09:13.306ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34172024-11-14T09:09:13.307ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34182024-11-14T09:09:13.307ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34192024-11-14T09:09:13.308ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34202024-11-14T09:09:13.309ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34212024-11-14T09:09:13.309ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34222024-11-14T09:09:13.310ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34232024-11-14T09:09:13.311ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34242024-11-14T09:09:18.048ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34252024-11-14T09:09:18.049ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34262024-11-14T09:09:22.533ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34272024-11-14T09:09:22.534ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34282024-11-14T09:09:22.535ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34292024-11-14T09:09:22.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34302024-11-14T09:09:22.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34312024-11-14T09:09:22.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34322024-11-14T09:09:22.538ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34332024-11-14T09:09:23.308ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34342024-11-14T09:09:23.309ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34352024-11-14T09:09:23.309ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34362024-11-14T09:09:23.310ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34372024-11-14T09:09:23.310ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34382024-11-14T09:09:23.311ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34392024-11-14T09:09:23.311ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34402024-11-14T09:09:23.312ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34412024-11-14T09:09:23.312ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34422024-11-14T09:09:23.869ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59943
34432024-11-14T09:09:23.870ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59943 req_id = 4777d0ea-4c0b-4d52-b4b3-8818cdd58e8a response_code = 200 uri = /baseboard
34442024-11-14T09:09:28.052ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34452024-11-14T09:09:28.053ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34462024-11-14T09:09:32.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34472024-11-14T09:09:32.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34482024-11-14T09:09:32.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34492024-11-14T09:09:32.538ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34502024-11-14T09:09:32.539ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34512024-11-14T09:09:32.540ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34522024-11-14T09:09:32.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34532024-11-14T09:09:33.313ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34542024-11-14T09:09:33.313ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34552024-11-14T09:09:33.314ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34562024-11-14T09:09:33.315ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34572024-11-14T09:09:33.315ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34582024-11-14T09:09:33.316ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34592024-11-14T09:09:33.317ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34602024-11-14T09:09:33.317ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34612024-11-14T09:09:33.318ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34622024-11-14T09:09:35.464ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34549
34632024-11-14T09:09:35.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34549 req_id = 2cf1e138-60ce-447a-aeab-0cb9fd5b1f1c response_code = 200 uri = /vpc-routes
34642024-11-14T09:09:35.530ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
34652024-11-14T09:09:35.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34549 req_id = 2ce8ff1e-2f6f-44d7-a560-24b3695ddcc0 response_code = 204 uri = /eip-gateways
34662024-11-14T09:09:35.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34549 req_id = f5d9e30d-127e-409b-bdc9-1ce92e3f8061 response_code = 204 uri = /vpc-routes
34672024-11-14T09:09:35.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42791
34682024-11-14T09:09:35.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42791 req_id = f1f2dadf-fd70-41ca-953e-5b6a787cc124 response_code = 200 uri = /v2p
34692024-11-14T09:09:35.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63532
34702024-11-14T09:09:35.601ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
34712024-11-14T09:09:35.666ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
34722024-11-14T09:09:35.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156395 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63532 req_id = 8db038ff-505b-4c64-9f5d-118cca226329 response_code = 204 uri = /switch-ports
34732024-11-14T09:09:35.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56152
34742024-11-14T09:09:35.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47526
34752024-11-14T09:09:35.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55824
34762024-11-14T09:09:35.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56152 req_id = a1363928-df41-47bb-94e8-262650de4347 response_code = 200 uri = /vpc-routes
34772024-11-14T09:09:35.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 360 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63532 req_id = f9ac255f-12a0-4aa3-8c49-6317ca2272da response_code = 200 uri = /network-bootstore-config
34782024-11-14T09:09:35.758ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
34792024-11-14T09:09:35.766ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44457
34802024-11-14T09:09:35.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16010 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47526 req_id = b081d792-0791-46a7-88c4-0b67cf2f5817 response_code = 200 uri = /v2p
34812024-11-14T09:09:35.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44457 req_id = f5864698-1ee1-47ab-976c-2ac36dea484d response_code = 200 uri = /vpc-routes
34822024-11-14T09:09:35.813ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
34832024-11-14T09:09:35.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56152 req_id = 2d5a52a3-364f-49e4-96cb-9dec3dbc8331 response_code = 204 uri = /eip-gateways
34842024-11-14T09:09:35.818ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
34852024-11-14T09:09:35.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1024 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56152 req_id = ffa06a3a-a1bd-458c-9319-aab59e798824 response_code = 204 uri = /vpc-routes
34862024-11-14T09:09:35.829ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
34872024-11-14T09:09:35.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44457 req_id = 3b9fd2c6-b682-46d3-a88c-5b26b35bcb3f response_code = 204 uri = /eip-gateways
34882024-11-14T09:09:35.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 832 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44457 req_id = 4f756f9f-e06c-4d08-a031-bfe474140dc1 response_code = 204 uri = /vpc-routes
34892024-11-14T09:09:35.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135957 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55824 req_id = 895206c7-7595-4b55-b26e-85f1111a21ac response_code = 204 uri = /switch-ports
34902024-11-14T09:09:35.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55824 req_id = 8c5f8939-be12-461d-b9ba-6824df908c6b response_code = 200 uri = /network-bootstore-config
34912024-11-14T09:09:35.907ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52647
34922024-11-14T09:09:35.907ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
34932024-11-14T09:09:35.943ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
34942024-11-14T09:09:36.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94877 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52647 req_id = 65f6c322-9ab0-43d6-af98-ca36fb03c1b5 response_code = 204 uri = /switch-ports
34952024-11-14T09:09:36.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48832
34962024-11-14T09:09:36.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52647 req_id = 5403938e-a945-4579-ace7-290f77ee64c2 response_code = 200 uri = /network-bootstore-config
34972024-11-14T09:09:36.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48832 req_id = 85042d61-f0b2-4b5b-ab60-7442643d82b8 response_code = 200 uri = /v2p
34982024-11-14T09:09:38.056ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
34992024-11-14T09:09:38.057ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35002024-11-14T09:09:42.538ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35012024-11-14T09:09:42.539ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35022024-11-14T09:09:42.539ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35032024-11-14T09:09:42.540ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35042024-11-14T09:09:42.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35052024-11-14T09:09:42.542ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35062024-11-14T09:09:42.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35072024-11-14T09:09:43.316ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35082024-11-14T09:09:43.317ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35092024-11-14T09:09:43.318ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35102024-11-14T09:09:43.318ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35112024-11-14T09:09:43.319ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35122024-11-14T09:09:43.320ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35132024-11-14T09:09:43.320ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35142024-11-14T09:09:43.321ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35152024-11-14T09:09:43.322ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35162024-11-14T09:09:48.061ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35172024-11-14T09:09:48.061ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35182024-11-14T09:09:52.540ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35192024-11-14T09:09:52.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35202024-11-14T09:09:52.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35212024-11-14T09:09:52.542ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35222024-11-14T09:09:52.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35232024-11-14T09:09:52.544ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35242024-11-14T09:09:52.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35252024-11-14T09:09:53.321ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35262024-11-14T09:09:53.322ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35272024-11-14T09:09:53.323ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35282024-11-14T09:09:53.324ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35292024-11-14T09:09:53.325ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35302024-11-14T09:09:53.326ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35312024-11-14T09:09:53.327ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35322024-11-14T09:09:53.328ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35332024-11-14T09:09:53.329ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35342024-11-14T09:09:53.904ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33688
35352024-11-14T09:09:53.904ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33688 req_id = 51600edd-ce5d-4be3-b5b9-c8cf70ce4ff1 response_code = 200 uri = /baseboard
35362024-11-14T09:09:58.064ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35372024-11-14T09:09:58.065ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35382024-11-14T09:10:02.542ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35392024-11-14T09:10:02.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35402024-11-14T09:10:02.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35412024-11-14T09:10:02.544ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35422024-11-14T09:10:02.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35432024-11-14T09:10:02.546ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35442024-11-14T09:10:02.547ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35452024-11-14T09:10:03.325ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35462024-11-14T09:10:03.326ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35472024-11-14T09:10:03.326ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35482024-11-14T09:10:03.327ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35492024-11-14T09:10:03.328ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35502024-11-14T09:10:03.329ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35512024-11-14T09:10:03.330ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35522024-11-14T09:10:03.330ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35532024-11-14T09:10:03.331ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35542024-11-14T09:10:05.135ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32922
35552024-11-14T09:10:05.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32922 req_id = 698653e4-8a34-4522-958a-1cc796e06c65 response_code = 200 uri = /v2p
35562024-11-14T09:10:05.140ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(7742553) }
35572024-11-14T09:10:05.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4387 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32922 req_id = e5e3c890-f9ac-463f-8c5f-eaf13876cd74 response_code = 204 uri = /v2p
35582024-11-14T09:10:05.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60922
35592024-11-14T09:10:05.293ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: afd7a81f-2b99-4dc7-a4a4-51f62010e2b7, kind: Instance { id: d7226786-0fed-42c5-98e3-b855e6f1b674 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7742553), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: afd7a81f-2b99-4dc7-a4a4-51f62010e2b7, kind: Instance { id: d7226786-0fed-42c5-98e3-b855e6f1b674 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7742553), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: afd7a81f-2b99-4dc7-a4a4-51f62010e2b7, kind: Instance { id: d7226786-0fed-42c5-98e3-b855e6f1b674 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7742553), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(7742553))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: afd7a81f-2b99-4dc7-a4a4-51f62010e2b7, kind: Instance { id: d7226786-0fed-42c5-98e3-b855e6f1b674 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7742553), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-fc42820ca50", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: fb895c3a-ed8f-4b6d-bcf0-4484c5a76753, read_only_parent: Some(Volume { block_size: 512, id: f5353f63-327e-46b8-bd90-41545ee09c29, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: f8dcde18-f067-42b2-b594-ca86f50d2da9, key: Some("jVIWX4IRgxYsJrSUftA7bSfWb+P8svJ6onritiBbxro="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::16]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: fb895c3a-ed8f-4b6d-bcf0-4484c5a76753, key: Some("m9nD4Kn+69wdwjU69a5pHPbZv5PIlaAH9aPv8oHBiD0="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::15]:19001"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-fc42820ca50" }] }), cloud_init_bytes: Some(..) } instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 metadata = InstanceMetadata { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, project_id: 8004ae3c-25df-43c0-8904-6502f5426c94 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-14T09:10:05.263056383Z }
35602024-11-14T09:10:05.293ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 migration_id = None propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
35612024-11-14T09:10:05.294ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 migration_id = None propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: afd7a81f-2b99-4dc7-a4a4-51f62010e2b7, kind: Instance { id: d7226786-0fed-42c5-98e3-b855e6f1b674 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7742553), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: afd7a81f-2b99-4dc7-a4a4-51f62010e2b7, kind: Instance { id: d7226786-0fed-42c5-98e3-b855e6f1b674 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7742553), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: afd7a81f-2b99-4dc7-a4a4-51f62010e2b7, kind: Instance { id: d7226786-0fed-42c5-98e3-b855e6f1b674 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7742553), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(7742553))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: afd7a81f-2b99-4dc7-a4a4-51f62010e2b7, kind: Instance { id: d7226786-0fed-42c5-98e3-b855e6f1b674 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7742553), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-fc42820ca50", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: fb895c3a-ed8f-4b6d-bcf0-4484c5a76753, read_only_parent: Some(Volume { block_size: 512, id: f5353f63-327e-46b8-bd90-41545ee09c29, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: f8dcde18-f067-42b2-b594-ca86f50d2da9, key: Some("jVIWX4IRgxYsJrSUftA7bSfWb+P8svJ6onritiBbxro="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::16]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: fb895c3a-ed8f-4b6d-bcf0-4484c5a76753, key: Some("m9nD4Kn+69wdwjU69a5pHPbZv5PIlaAH9aPv8oHBiD0="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::15]:19001"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-fc42820ca50" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-14T09:10:05.263056383Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
35622024-11-14T09:10:05.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32649 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60922 req_id = 5a2f7859-f37a-4f72-b21c-ac3305f98fdb response_code = 200 uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
35632024-11-14T09:10:05.547ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36150
35642024-11-14T09:10:05.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2580 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36150 req_id = dd259b23-3616-4d07-87b7-f66dce5bfab6 response_code = 200 uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576/state
35652024-11-14T09:10:05.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61895
35662024-11-14T09:10:05.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61895 req_id = 7086979d-3971-412a-a3fe-9ac0e0285d8f response_code = 200 uri = /vpc-routes
35672024-11-14T09:10:05.731ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {afd7a81f-2b99-4dc7-a4a4-51f62010e2b7: {10.151.1.175: {a02413d9-e2c1-4708-8e13-eda1e94e4206}, 10.151.1.176: {a02413d9-e2c1-4708-8e13-eda1e94e4206}}} }
35682024-11-14T09:10:05.734ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1231 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
35692024-11-14T09:10:05.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3776 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61895 req_id = e3dd7eea-87cf-49fe-a93d-7905f588973c response_code = 204 uri = /eip-gateways
35702024-11-14T09:10:05.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61895 req_id = e2e28635-4260-434f-b02d-21ffd99bd445 response_code = 204 uri = /vpc-routes
35712024-11-14T09:10:05.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51711
35722024-11-14T09:10:05.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1399 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51711 req_id = 39e33c65-eeeb-49c1-9835-cfefb6d5bfdc response_code = 200 uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576/state
35732024-11-14T09:10:05.808ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 7742553 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
35742024-11-14T09:10:05.808ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
35752024-11-14T09:10:05.818ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64444
35762024-11-14T09:10:05.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64444 req_id = 9ce1716d-42e2-41c3-9c2f-97aed3dd6680 response_code = 200 uri = /v2p
35772024-11-14T09:10:05.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42488
35782024-11-14T09:10:05.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42488 req_id = 6148a3d8-cc2e-416f-aed8-4094f3c21170 response_code = 200 uri = /v2p
35792024-11-14T09:10:05.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48624
35802024-11-14T09:10:05.859ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
35812024-11-14T09:10:05.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63067
35822024-11-14T09:10:05.868ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576 file = illumos-utils/src/zone.rs:325 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
35832024-11-14T09:10:05.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61458
35842024-11-14T09:10:05.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61458 req_id = a88587ba-9d93-434a-ad1a-5898e51b10d8 response_code = 200 uri = /vpc-routes
35852024-11-14T09:10:05.901ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576 file = illumos-utils/src/zone.rs:363 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
35862024-11-14T09:10:05.908ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {afd7a81f-2b99-4dc7-a4a4-51f62010e2b7: {10.151.1.175: {a02413d9-e2c1-4708-8e13-eda1e94e4206}, 10.151.1.176: {a02413d9-e2c1-4708-8e13-eda1e94e4206}}} }
35872024-11-14T09:10:05.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7719 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61458 req_id = 1fbce116-be8a-4988-90ca-647b2a87be7f response_code = 204 uri = /eip-gateways
35882024-11-14T09:10:05.913ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
35892024-11-14T09:10:05.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37565
35902024-11-14T09:10:05.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40711
35912024-11-14T09:10:05.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 553 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61458 req_id = 7e5908c5-b57f-48df-bc17-ca6564718b60 response_code = 204 uri = /vpc-routes
35922024-11-14T09:10:05.998ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
35932024-11-14T09:10:05.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139559 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48624 req_id = 59d5c2f0-bdcf-4778-bfeb-0fe02bebaa6a response_code = 204 uri = /switch-ports
35942024-11-14T09:10:06.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1077 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48624 req_id = 3eb7b368-b606-4ec8-a55e-8cf1dfc269b8 response_code = 200 uri = /network-bootstore-config
35952024-11-14T09:10:06.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47704
35962024-11-14T09:10:06.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47704 req_id = f329d1e8-7b9f-4c7a-9926-9a3ec869a010 response_code = 200 uri = /vpc-routes
35972024-11-14T09:10:06.077ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
35982024-11-14T09:10:06.085ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {afd7a81f-2b99-4dc7-a4a4-51f62010e2b7: {10.151.1.176: {a02413d9-e2c1-4708-8e13-eda1e94e4206}, 10.151.1.175: {a02413d9-e2c1-4708-8e13-eda1e94e4206}}} }
35992024-11-14T09:10:06.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 883 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47704 req_id = 94070cda-55b1-40b3-b96b-4ff42157c450 response_code = 204 uri = /eip-gateways
36002024-11-14T09:10:06.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 728 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47704 req_id = 41f5a67a-e3d2-4021-920d-aea8d4939b35 response_code = 204 uri = /vpc-routes
36012024-11-14T09:10:06.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199435 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37565 req_id = b410f670-8eae-4699-bf43-d2560d446f7b response_code = 204 uri = /switch-ports
36022024-11-14T09:10:06.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37565 req_id = c4f3ce0c-f6ac-45e2-9299-cf87ce3ae04f response_code = 200 uri = /network-bootstore-config
36032024-11-14T09:10:06.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64653
36042024-11-14T09:10:06.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64653 req_id = 61eb3ead-a3bb-41ab-8cec-08b4236cad9d response_code = 200 uri = /v2p
36052024-11-14T09:10:06.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52536
36062024-11-14T09:10:06.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52536 req_id = be1042f2-7089-41bc-ae18-8009c2464589 response_code = 200 uri = /vpc-routes
36072024-11-14T09:10:06.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57124
36082024-11-14T09:10:06.249ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
36092024-11-14T09:10:06.317ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
36102024-11-14T09:10:06.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164649 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57124 req_id = a61daa48-c504-46ab-a17b-59548a2ba912 response_code = 204 uri = /switch-ports
36112024-11-14T09:10:06.414ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {afd7a81f-2b99-4dc7-a4a4-51f62010e2b7: {10.151.1.176: {a02413d9-e2c1-4708-8e13-eda1e94e4206}, 10.151.1.175: {a02413d9-e2c1-4708-8e13-eda1e94e4206}}} }
36122024-11-14T09:10:06.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52536 req_id = 280d9621-4420-4b90-bb6b-a72a67578dff response_code = 204 uri = /eip-gateways
36132024-11-14T09:10:06.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57124 req_id = 6e57f3a9-f588-4a6a-bdb9-0adbcd995889 response_code = 200 uri = /network-bootstore-config
36142024-11-14T09:10:06.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52536 req_id = 9f67e8e3-bf15-4b43-844e-4c6cc9901d35 response_code = 204 uri = /vpc-routes
36152024-11-14T09:10:07.513ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
36162024-11-14T09:10:07.513ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576 zone file = illumos-utils/src/running_zone.rs:488 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 zone = oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576
36172024-11-14T09:10:07.707ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576") failed: Property not found. retry in 36.686147ms file = illumos-utils/src/svc.rs:36 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 zone = oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576
36182024-11-14T09:10:07.754ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576") failed: Property not found. retry in 71.952473ms file = illumos-utils/src/svc.rs:36 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 zone = oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576
36192024-11-14T09:10:07.846ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576") failed: Property not found. retry in 279.456327ms file = illumos-utils/src/svc.rs:36 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 zone = oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576
36202024-11-14T09:10:08.069ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36212024-11-14T09:10:08.070ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36222024-11-14T09:10:08.142ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576") failed: Property not found. retry in 487.917541ms file = illumos-utils/src/svc.rs:36 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 zone = oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576
36232024-11-14T09:10:08.646ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576") failed: Property not found. retry in 851.75436ms file = illumos-utils/src/svc.rs:36 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 zone = oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576
36242024-11-14T09:10:09.511ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576") failed: Property not found. retry in 839.66177ms file = illumos-utils/src/svc.rs:36 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 zone = oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576
36252024-11-14T09:10:10.365ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576") failed: Property not found. retry in 585.281201ms file = illumos-utils/src/svc.rs:36 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 zone = oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576
36262024-11-14T09:10:10.964ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576") failed: Property not found. retry in 731.804045ms file = illumos-utils/src/svc.rs:36 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 zone = oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576
36272024-11-14T09:10:11.708ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576") failed: Property not found. retry in 778.983541ms file = illumos-utils/src/svc.rs:36 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 zone = oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576
36282024-11-14T09:10:12.520ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576 file = sled-agent/src/instance.rs:1787 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
36292024-11-14T09:10:12.532ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576") failed: Property not found. retry in 40.701194ms file = illumos-utils/src/svc.rs:36 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
36302024-11-14T09:10:12.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36312024-11-14T09:10:12.546ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36322024-11-14T09:10:12.547ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36332024-11-14T09:10:12.547ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36342024-11-14T09:10:12.548ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36352024-11-14T09:10:12.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36362024-11-14T09:10:12.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36372024-11-14T09:10:12.584ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576") failed: Property not found. retry in 126.965495ms file = illumos-utils/src/svc.rs:36 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
36382024-11-14T09:10:12.723ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576") failed: Property not found. retry in 128.607696ms file = illumos-utils/src/svc.rs:36 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
36392024-11-14T09:10:12.865ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576") failed: Property not found. retry in 230.774878ms file = illumos-utils/src/svc.rs:36 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
36402024-11-14T09:10:13.110ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576") failed: Property not found. retry in 1.076016766s file = illumos-utils/src/svc.rs:36 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
36412024-11-14T09:10:13.329ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36422024-11-14T09:10:13.330ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36432024-11-14T09:10:13.331ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36442024-11-14T09:10:13.331ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36452024-11-14T09:10:13.332ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36462024-11-14T09:10:13.333ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36472024-11-14T09:10:13.333ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36482024-11-14T09:10:13.334ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36492024-11-14T09:10:13.335ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36502024-11-14T09:10:14.199ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
36512024-11-14T09:10:14.234ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
36522024-11-14T09:10:14.373ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
36532024-11-14T09:10:14.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8382826 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40711 req_id = 5c740a4f-d368-40d5-927d-4b05070f9eae response_code = 200 uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576/state
36542024-11-14T09:10:14.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8509977 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63067 req_id = 303d3e0d-3686-4671-ae44-8d23ff3b9bd6 response_code = 200 uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576/state
36552024-11-14T09:10:14.376ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-14T09:10:14.376565869Z } file = sled-agent/src/instance.rs:780 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
36562024-11-14T09:10:14.376ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-14T09:10:14.376565869Z } propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
36572024-11-14T09:10:14.376ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-14T09:10:14.376565869Z }, migration_in: None, migration_out: None }
36582024-11-14T09:10:14.400ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-14T09:10:14.400557184Z } file = sled-agent/src/instance.rs:780 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
36592024-11-14T09:10:14.400ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-14T09:10:14.400557184Z } propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
36602024-11-14T09:10:14.400ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-14T09:10:14.400557184Z }, migration_in: None, migration_out: None }
36612024-11-14T09:10:18.072ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36622024-11-14T09:10:18.073ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36632024-11-14T09:10:22.548ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36642024-11-14T09:10:22.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36652024-11-14T09:10:22.550ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36662024-11-14T09:10:22.551ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36672024-11-14T09:10:22.551ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36682024-11-14T09:10:22.552ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36692024-11-14T09:10:22.553ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36702024-11-14T09:10:23.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34473
36712024-11-14T09:10:23.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 658 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34473 req_id = 344634aa-86eb-400e-906c-b00ae9a87412 response_code = 200 uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576/state
36722024-11-14T09:10:23.103ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-14T09:10:23.103219929Z } file = sled-agent/src/instance.rs:780 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
36732024-11-14T09:10:23.103ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-14T09:10:23.103219929Z } propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
36742024-11-14T09:10:23.103ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-14T09:10:23.103219929Z }, migration_in: None, migration_out: None }
36752024-11-14T09:10:23.143ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-14T09:10:23.143859882Z } file = sled-agent/src/instance.rs:780 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
36762024-11-14T09:10:23.143ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-14T09:10:23.143859882Z } propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
36772024-11-14T09:10:23.143ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
36782024-11-14T09:10:23.143ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
36792024-11-14T09:10:23.144ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
36802024-11-14T09:10:23.144ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/6c1654e8-5949-490c-b293-edf8cb5a6332/debug/bundle/zone", "/pool/int/7b47c429-1e53-46e1-a6dc-8833bde95c8b/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/371f3005-927c-4e65-88a0-18072469758d/crypt/debug", "/pool/ext/adf8829f-c3eb-4450-b693-c7220506810c/crypt/debug", "/pool/ext/7d1e429d-74f9-4a0f-9382-4b993f07db56/crypt/debug", "/pool/ext/493c27e1-df39-477b-8315-ad9aa5767668/crypt/debug", "/pool/ext/ef6848de-2e18-4d49-825f-a08523c761f3/crypt/debug", "/pool/ext/6032d020-e97f-4442-878e-bcdbe3293876/crypt/debug", "/pool/ext/8a4b1a2c-0585-4f12-8c9a-b7cf61af774a/crypt/debug", "/pool/ext/d752d0db-efe8-492a-8a25-a56ee29e644b/crypt/debug", "/pool/ext/75e5cd88-3bd4-424c-8d3b-ed5afb3d33b7/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576
36812024-11-14T09:10:23.338ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36822024-11-14T09:10:23.339ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36832024-11-14T09:10:23.340ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36842024-11-14T09:10:23.340ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36852024-11-14T09:10:23.341ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36862024-11-14T09:10:23.342ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36872024-11-14T09:10:23.342ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36882024-11-14T09:10:23.343ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36892024-11-14T09:10:23.344ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
36902024-11-14T09:10:23.811ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576", bundle_id: 97dd6637-12a5-4a5c-a100-287a5e36ddba }, time_created: 2024-11-14T09:10:23.145397047Z, version: 0, cause: TerminatedInstance }
36912024-11-14T09:10:23.811ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_d785d5c4-4fef-4c27-9392-a8d40aec1576 file = sled-agent/src/instance.rs:1032 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
36922024-11-14T09:10:23.936ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57546
36932024-11-14T09:10:23.936ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57546 req_id = 88cd11c8-5588-4b09-8a6f-cd9b1343c44b response_code = 200 uri = /baseboard
36942024-11-14T09:10:25.555ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
36952024-11-14T09:10:25.575ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(7742553), kind: System }
36962024-11-14T09:10:25.575ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(7742553), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
36972024-11-14T09:10:25.575ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-14T09:10:25.575776933Z }, migration_in: None, migration_out: None }
36982024-11-14T09:10:25.600ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-14T09:10:25.575776933Z }, migration_in: None, migration_out: None }
36992024-11-14T09:10:25.603ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
37002024-11-14T09:10:26.114ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64705
37012024-11-14T09:10:26.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64705 req_id = fc6d5a2c-b366-4892-8d75-f19954c6f808 response_code = 200 uri = /vpc-routes
37022024-11-14T09:10:26.127ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
37032024-11-14T09:10:26.127ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1231 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
37042024-11-14T09:10:26.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64705 req_id = 7cff28ea-c1b5-40e3-9066-27e3e24f9fcf response_code = 204 uri = /eip-gateways
37052024-11-14T09:10:26.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64705 req_id = 7b3f5ef2-9287-43e6-93e0-05b44c9ac3ad response_code = 204 uri = /vpc-routes
37062024-11-14T09:10:26.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48077
37072024-11-14T09:10:26.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48077 req_id = 76affdbf-56d1-4d89-ab32-b2bdd62f7bde response_code = 200 uri = /v2p
37082024-11-14T09:10:27.466ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63639
37092024-11-14T09:10:27.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63639 req_id = dad50f72-cc0d-424e-a2a0-622226df2309 response_code = 200 uri = /vpc-routes
37102024-11-14T09:10:27.485ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
37112024-11-14T09:10:27.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63639 req_id = 9fbf76f0-deb9-491d-8102-aea4a354060f response_code = 204 uri = /eip-gateways
37122024-11-14T09:10:27.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58535
37132024-11-14T09:10:27.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58535 req_id = 2039c5aa-efd1-4264-a565-d7ad6e99cef8 response_code = 200 uri = /v2p
37142024-11-14T09:10:27.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63639 req_id = 0dd74fd1-9da4-4adb-a428-a5a11f1c243d response_code = 204 uri = /vpc-routes
37152024-11-14T09:10:28.076ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
37162024-11-14T09:10:28.076ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87
37172024-11-14T09:10:28.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50771
37182024-11-14T09:10:28.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50771 req_id = 21c2cf7e-1fb1-4ffa-9fa0-f924fcc05d66 response_code = 200 uri = /vpc-routes
37192024-11-14T09:10:28.166ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 values = ExternalIpGatewayMap { mappings: {} }
37202024-11-14T09:10:28.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50771 req_id = a42db169-8c84-4747-91b1-1e6be44350fd response_code = 204 uri = /eip-gateways
37212024-11-14T09:10:28.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50771 req_id = c782d01d-28f2-4324-844b-badf984caf32 response_code = 204 uri = /vpc-routes