Max level shown:
1 [ Nov 9 01:20:12 Enabled. ]
2 [ Nov 9 01:20:12 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 9 01:20:12 Method "start" exited with status 0. ]
4 [ Nov 9 01:20:12 Rereading configuration. ]
5 [ Nov 9 01:20:12 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-09T01:20:12.990ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-09T01:20:12.990ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-09T01:20:13.044ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-09T01:20:13.044ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-09T01:20:13.158ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-09T01:20:13.167ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-09T01:20:13.176ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-09T01:20:13.777ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-11-09T01:20:13.914ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-09T01:20:13.914ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-09T01:20:13.914ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-09T01:20:13.914ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-09T01:20:13.914ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-11-09T01:20:13.914ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-11-09T01:20:13.917ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-09T01:20:13.917ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-09T01:20:13.917ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-09T01:20:13.917ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-09T01:20:13.917ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-09T01:20:13.917ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-09T01:20:13.917ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-11-09T01:20:13.917ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-09T01:20:13.917ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-09T01:20:13.928ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-09T01:20:13.928ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = f925765a-5a42-4a3d-aa53-e9481c784b20 (zpool)
322024-11-09T01:20:14.029ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f925765a-5a42-4a3d-aa53-e9481c784b20 (zpool), kind: Internal }
332024-11-09T01:20:14.476ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-11-09T01:20:14.476ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-09T01:20:14.476ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-09T01:20:14.476ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-09T01:20:14.476ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-11-09T01:20:14.476ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-09T01:20:14.476ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-09T01:20:14.484ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-09T01:20:14.484ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 8d8ef7b1-4af4-4c69-9e3f-98ca7b356569 (zpool)
422024-11-09T01:20:14.568ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8d8ef7b1-4af4-4c69-9e3f-98ca7b356569 (zpool), kind: Internal }
432024-11-09T01:20:15.040ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-09T01:20:15.040ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f925765a-5a42-4a3d-aa53-e9481c784b20 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8d8ef7b1-4af4-4c69-9e3f-98ca7b356569 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-09T01:20:15.040ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-11-09T01:20:15.040ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-11-09T01:20:15.040ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
482024-11-09T01:20:15.040ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-11-09T01:20:15.040ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-09T01:20:15.040ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f925765a-5a42-4a3d-aa53-e9481c784b20 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8d8ef7b1-4af4-4c69-9e3f-98ca7b356569 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-11-09T01:20:15.040ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-11-09T01:20:15.040ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
532024-11-09T01:20:15.040ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
542024-11-09T01:20:15.040ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552024-11-09T01:20:15.040ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-09T01:20:15.040ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f925765a-5a42-4a3d-aa53-e9481c784b20 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8d8ef7b1-4af4-4c69-9e3f-98ca7b356569 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-11-09T01:20:15.040ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
582024-11-09T01:20:15.040ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-11-09T01:20:15.040ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
602024-11-09T01:20:15.040ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
612024-11-09T01:20:15.040ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
622024-11-09T01:20:15.040ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
632024-11-09T01:20:15.040ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
642024-11-09T01:20:15.040ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
652024-11-09T01:20:15.040ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
662024-11-09T01:20:15.040ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
672024-11-09T01:20:15.040ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
682024-11-09T01:20:15.040ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f925765a-5a42-4a3d-aa53-e9481c784b20 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8d8ef7b1-4af4-4c69-9e3f-98ca7b356569 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-11-09T01:20:15.040ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-11-09T01:20:15.040ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-11-09T01:20:15.040ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
722024-11-09T01:20:15.040ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
732024-11-09T01:20:15.040ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f925765a-5a42-4a3d-aa53-e9481c784b20 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8d8ef7b1-4af4-4c69-9e3f-98ca7b356569 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
742024-11-09T01:20:15.040ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
752024-11-09T01:20:15.040ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-11-09T01:20:15.040ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-11-09T01:20:15.040ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-11-09T01:20:15.040ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
792024-11-09T01:20:15.040ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f925765a-5a42-4a3d-aa53-e9481c784b20 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8d8ef7b1-4af4-4c69-9e3f-98ca7b356569 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
802024-11-09T01:20:15.040ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
812024-11-09T01:20:15.040ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
822024-11-09T01:20:15.040ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
832024-11-09T01:20:15.040ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f925765a-5a42-4a3d-aa53-e9481c784b20 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8d8ef7b1-4af4-4c69-9e3f-98ca7b356569 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
842024-11-09T01:20:15.040ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
852024-11-09T01:20:15.040ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
862024-11-09T01:20:15.040ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
872024-11-09T01:20:15.040ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
882024-11-09T01:20:15.040ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
892024-11-09T01:20:15.040ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f925765a-5a42-4a3d-aa53-e9481c784b20 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8d8ef7b1-4af4-4c69-9e3f-98ca7b356569 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
902024-11-09T01:20:15.040ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
912024-11-09T01:20:15.040ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
922024-11-09T01:20:15.040ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
932024-11-09T01:20:15.040ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-11-09T01:20:15.040ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
952024-11-09T01:20:15.040ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
962024-11-09T01:20:15.040ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f925765a-5a42-4a3d-aa53-e9481c784b20 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8d8ef7b1-4af4-4c69-9e3f-98ca7b356569 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
972024-11-09T01:20:15.040ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
982024-11-09T01:20:15.040ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
992024-11-09T01:20:15.040ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1002024-11-09T01:20:15.040ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1012024-11-09T01:20:15.040ZINFOSledAgent (bootstore): No ledger in /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1022024-11-09T01:20:15.041ZINFOSledAgent (bootstore): No ledger in /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1032024-11-09T01:20:15.041ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1042024-11-09T01:20:15.041ZINFOSledAgent (bootstore): No ledger in /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-11-09T01:20:15.041ZINFOSledAgent (bootstore): No ledger in /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-11-09T01:20:15.041ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1072024-11-09T01:20:15.041ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1082024-11-09T01:20:15.041ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1092024-11-09T01:20:15.052ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1102024-11-09T01:20:15.052ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1132, tv_nsec: 630309811 } time_to_next_cleanup = 599.9999499s
1112024-11-09T01:20:15.052ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1122024-11-09T01:20:15.052ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1132024-11-09T01:20:15.052ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/sled-agent-request.json file = common/src/ledger.rs:188
1142024-11-09T01:20:15.052ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/sled-agent-request.json file = common/src/ledger.rs:188
1152024-11-09T01:20:15.055ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1162024-11-09T01:20:15.057ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1172024-11-09T01:20:15.057ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1198
1182024-11-09T01:20:15.057ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1192024-11-09T01:20:15.057ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1202024-11-09T01:20:15.057ZINFOSledAgent (RSS): No ledger in /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1212024-11-09T01:20:15.057ZINFOSledAgent (RSS): No ledger in /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1222024-11-09T01:20:15.057ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1261
1232024-11-09T01:20:15.057ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1242024-11-09T01:20:15.057ZINFOSledAgent (RSS): No ledger in /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/rss-sled-plan.json file = common/src/ledger.rs:188
1252024-11-09T01:20:15.057ZINFOSledAgent (RSS): No ledger in /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/rss-sled-plan.json file = common/src/ledger.rs:188
1262024-11-09T01:20:15.057ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1303
1272024-11-09T01:20:15.057ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1282024-11-09T01:20:15.057ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1292024-11-09T01:20:15.057ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1302024-11-09T01:20:15.057ZINFOSledAgent (RSS): Writing ledger to /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1312024-11-09T01:20:15.058ZINFOSledAgent (RSS): Writing ledger to /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1322024-11-09T01:20:15.058ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: 54080907-d4a8-4f65-b867-da4e2da6d2ba, sleds: { [fdb0:18c0:4d0d:a02a::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 8c24f6fb-cc5e-4758-a216-4357bbb5d813 (sled), rack_id: 54080907-d4a8-4f65-b867-da4e2da6d2ba, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1332024-11-09T01:20:15.058ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1337
1342024-11-09T01:20:15.058ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1352024-11-09T01:20:15.058ZINFOSledAgent (bootstore): Writing ledger to /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1362024-11-09T01:20:15.058ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372024-11-09T01:20:15.058ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1382024-11-09T01:20:15.058ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 8c24f6fb-cc5e-4758-a216-4357bbb5d813 (sled), rack_id: 54080907-d4a8-4f65-b867-da4e2da6d2ba, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1392024-11-09T01:20:15.059ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1402024-11-09T01:20:15.059ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1412024-11-09T01:20:15.064ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1422024-11-09T01:20:15.070ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1432024-11-09T01:20:15.070ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1442024-11-09T01:20:15.074ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1452024-11-09T01:20:15.074ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1462024-11-09T01:20:15.074ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:36641
1472024-11-09T01:20:15.074ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 8c24f6fb-cc5e-4758-a216-4357bbb5d813 (sled), rack_id: 54080907-d4a8-4f65-b867-da4e2da6d2ba, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1482024-11-09T01:20:15.074ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1492024-11-09T01:20:15.074ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1502024-11-09T01:20:15.074ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1512024-11-09T01:20:15.074ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1522024-11-09T01:20:15.074ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1532024-11-09T01:20:15.075ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1542024-11-09T01:20:15.075ZINFOSledAgent (StorageManager): No ledger in /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552024-11-09T01:20:15.075ZINFOSledAgent (StorageManager): No ledger in /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562024-11-09T01:20:15.075ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1572024-11-09T01:20:15.075ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1582024-11-09T01:20:15.075ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1592024-11-09T01:20:15.075ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1602024-11-09T01:20:15.075ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1612024-11-09T01:20:15.091ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1622024-11-09T01:20:15.112ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1632024-11-09T01:20:15.126ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:407 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
1642024-11-09T01:20:15.126ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1652024-11-09T01:20:15.126ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:419 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
1662024-11-09T01:20:15.126ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1672024-11-09T01:20:15.128ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1682024-11-09T01:20:15.132ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 142.199294ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "bff10bce-11b6-4c00-9cc2-651253ba581d", "content-length": "124", "date": "Sat, 09 Nov 2024 01:20:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "bff10bce-11b6-4c00-9cc2-651253ba581d" } file = clients/ddm-admin-client/src/lib.rs:177
1692024-11-09T01:20:15.139ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_f925765a-5a42-4a3d-aa53-e9481c784b20/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1702024-11-09T01:20:15.163ZINFOSledAgent: successfully created encrypted zvol: name="oxi_f925765a-5a42-4a3d-aa53-e9481c784b20/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1712024-11-09T01:20:15.163ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_f925765a-5a42-4a3d-aa53-e9481c784b20/swap" file = sled-agent/src/swap_device.rs:96
1722024-11-09T01:20:15.168ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:434 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
1732024-11-09T01:20:15.168ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1742024-11-09T01:20:15.168ZINFOSledAgent (BackingFs): Ensuring dataset oxi_f925765a-5a42-4a3d-aa53-e9481c784b20/backing/fmd file = sled-agent/src/backing_fs.rs:138
1752024-11-09T01:20:15.255ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1762024-11-09T01:20:15.275ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772024-11-09T01:20:15.276ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 159.916268ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1790d189-1799-47f9-9b64-6dd3fa97acae", "content-length": "124", "date": "Sat, 09 Nov 2024 01:20:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1790d189-1799-47f9-9b64-6dd3fa97acae" } file = clients/ddm-admin-client/src/lib.rs:177
1782024-11-09T01:20:15.437ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1792024-11-09T01:20:15.437ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 73.523317ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3e30ff2c-4deb-4de7-8498-2fad5b0807cc", "content-length": "124", "date": "Sat, 09 Nov 2024 01:20:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3e30ff2c-4deb-4de7-8498-2fad5b0807cc" } file = clients/ddm-admin-client/src/lib.rs:177
1802024-11-09T01:20:15.474ZINFOSledAgent (BackingFs): Mounting oxi_f925765a-5a42-4a3d-aa53-e9481c784b20/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1812024-11-09T01:20:15.487ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1822024-11-09T01:20:15.487ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1832024-11-09T01:20:15.487ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1842024-11-09T01:20:15.487ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1852024-11-09T01:20:15.512ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1862024-11-09T01:20:15.512ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 214.598015ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7b5ca737-7ddd-4e20-b14b-3974cb67247b", "content-length": "124", "date": "Sat, 09 Nov 2024 01:20:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7b5ca737-7ddd-4e20-b14b-3974cb67247b" } file = clients/ddm-admin-client/src/lib.rs:177
1872024-11-09T01:20:15.728ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1882024-11-09T01:20:15.730ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 257.74207ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5693935e-6313-4f0a-b96e-aade25ffe392", "content-length": "124", "date": "Sat, 09 Nov 2024 01:20:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5693935e-6313-4f0a-b96e-aade25ffe392" } file = clients/ddm-admin-client/src/lib.rs:177
1892024-11-09T01:20:15.989ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1902024-11-09T01:20:15.990ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 245.670801ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3636d546-0c66-4763-ae6d-7015d835510b", "content-length": "124", "date": "Sat, 09 Nov 2024 01:20:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3636d546-0c66-4763-ae6d-7015d835510b" } file = clients/ddm-admin-client/src/lib.rs:177
1912024-11-09T01:20:16.218ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
1922024-11-09T01:20:16.223ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:52815 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
1932024-11-09T01:20:16.224ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
1942024-11-09T01:20:16.224ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:52815 file = oximeter/producer/src/lib.rs:283 interval = 30s producer_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
1952024-11-09T01:20:16.225ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 200.061049ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
1962024-11-09T01:20:16.226ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
1972024-11-09T01:20:16.226ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
1982024-11-09T01:20:16.226ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
1992024-11-09T01:20:16.226ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2002024-11-09T01:20:16.237ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2012024-11-09T01:20:16.426ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 371.867715ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
2022024-11-09T01:20:16.799ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 878.281769ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
2032024-11-09T01:20:17.678ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.889324595s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
2042024-11-09T01:20:18.846ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2052024-11-09T01:20:18.846ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2062024-11-09T01:20:18.846ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2072024-11-09T01:20:18.846ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2082024-11-09T01:20:18.846ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2092024-11-09T01:20:18.846ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2102024-11-09T01:20:18.848ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2112024-11-09T01:20:18.849ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2122024-11-09T01:20:18.849ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='0b7e3a2a-2678-430a-9e61-79da480570a8'/> <propval type="astring" name="rack_id" value='54080907-d4a8-4f65-b867-da4e2da6d2ba'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:feed:90da'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='54080907-d4a8-4f65-b867-da4e2da6d2ba'/> <propval type="astring" name="sled_id" value='8c24f6fb-cc5e-4758-a216-4357bbb5d813'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='8c24f6fb-cc5e-4758-a216-4357bbb5d813'/> <propval type="astring" name="rack_uuid" value='54080907-d4a8-4f65-b867-da4e2da6d2ba'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='8c24f6fb-cc5e-4758-a216-4357bbb5d813'/> <propval type="astring" name="rack_uuid" value='54080907-d4a8-4f65-b867-da4e2da6d2ba'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2132024-11-09T01:20:18.850ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2142024-11-09T01:20:19.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 68.793495ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2152024-11-09T01:20:19.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 94.463892ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2162024-11-09T01:20:19.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 279.969517ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2172024-11-09T01:20:19.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 356.684906ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-11-09T01:20:20.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 659.336984ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-11-09T01:20:20.569ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.304034897s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
2202024-11-09T01:20:21.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.279191808s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-11-09T01:20:22.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.267182985s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-11-09T01:20:24.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.046762299s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-11-09T01:20:24.064ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.679253497s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
2242024-11-09T01:20:25.381ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/8c24f6fb-cc5e-4758-a216-4357bbb5d813) file = sled-agent/src/nexus.rs:527 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
2252024-11-09T01:20:25.411ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2262024-11-09T01:20:25.411ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
2272024-11-09T01:20:25.412ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:12345
2282024-11-09T01:20:25.412ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2292024-11-09T01:20:25.412ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2302024-11-09T01:20:25.412ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2312024-11-09T01:20:25.412ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2322024-11-09T01:20:25.412ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2332024-11-09T01:20:25.412ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2342024-11-09T01:20:25.413ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:36641
2352024-11-09T01:20:25.413ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2362024-11-09T01:20:25.645ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2372024-11-09T01:20:25.645ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2382024-11-09T01:20:25.645ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2392024-11-09T01:20:25.645ZINFOSledAgent (RSS): No ledger in /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2402024-11-09T01:20:25.645ZINFOSledAgent (RSS): No ledger in /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2412024-11-09T01:20:25.645ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2422024-11-09T01:20:25.645ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2432024-11-09T01:20:25.645ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2442024-11-09T01:20:25.645ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2452024-11-09T01:20:25.650ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2462024-11-09T01:20:25.650ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2472024-11-09T01:20:25.650ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2482024-11-09T01:20:25.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34037
2492024-11-09T01:20:25.910ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2502024-11-09T01:20:25.910ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2512024-11-09T01:20:25.910ZINFOSledAgent (ServiceManager): No ledger in /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/omicron-zones.json file = common/src/ledger.rs:188
2522024-11-09T01:20:25.910ZINFOSledAgent (ServiceManager): No ledger in /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/omicron-zones.json file = common/src/ledger.rs:188
2532024-11-09T01:20:25.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34037 req_id = 921fd95b-2533-48bd-89cd-d14f5bdd6d31 response_code = 200 uri = /inventory
2542024-11-09T01:20:25.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40811
2552024-11-09T01:20:25.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40811 req_id = 2fa36f35-68e8-4a04-9fdf-f0d3c5be4cb1 response_code = 200 uri = /sled-role
2562024-11-09T01:20:25.940ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2572024-11-09T01:20:25.940ZINFOSledAgent (RSS): Writing ledger to /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2582024-11-09T01:20:25.941ZINFOSledAgent (RSS): Writing ledger to /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2592024-11-09T01:20:25.941ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:980
2602024-11-09T01:20:25.972ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: c155e4ff-a1e4-481e-acfd-e756f2270a4c, pool_id: ab413033-915c-42e6-846f-3f01a7447749 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 5f450664-3eea-4074-84d7-ccdaa3209cd4, pool_id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 4ac454a9-5b53-4eac-8434-b84081c84d22, pool_id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: ad354db5-29d4-4edf-af6f-4b3eedf99147, pool_id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 5b3cafd2-46a6-413e-bd06-faa426a2f627, pool_id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 36ddf206-dfcd-4f14-a0d9-812cb7fc86e4, pool_id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 215d855b-fffb-414e-858a-01c7942d23f8, pool_id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 27018371-1360-4708-bd12-22a09c5e20d4, pool_id: 429a71c0-de37-4c29-9517-d34e0fdea40d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 10ea1d45-b933-4d04-bd9b-fb81637837e6, pool_id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool) }] } file = sled-agent/src/rack_setup/service.rs:382 sled_address = [fd00:1122:3344:101::1]:12345
2612024-11-09T01:20:25.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57160
2622024-11-09T01:20:25.973ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:883 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
2632024-11-09T01:20:25.973ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: c155e4ff-a1e4-481e-acfd-e756f2270a4c, pool_id: ab413033-915c-42e6-846f-3f01a7447749 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 5f450664-3eea-4074-84d7-ccdaa3209cd4, pool_id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 4ac454a9-5b53-4eac-8434-b84081c84d22, pool_id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: ad354db5-29d4-4edf-af6f-4b3eedf99147, pool_id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 5b3cafd2-46a6-413e-bd06-faa426a2f627, pool_id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 36ddf206-dfcd-4f14-a0d9-812cb7fc86e4, pool_id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 215d855b-fffb-414e-858a-01c7942d23f8, pool_id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 27018371-1360-4708-bd12-22a09c5e20d4, pool_id: 429a71c0-de37-4c29-9517-d34e0fdea40d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 10ea1d45-b933-4d04-bd9b-fb81637837e6, pool_id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2642024-11-09T01:20:25.973ZINFOSledAgent (StorageManager): No ledger in /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2652024-11-09T01:20:25.973ZINFOSledAgent (StorageManager): No ledger in /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2662024-11-09T01:20:25.973ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2672024-11-09T01:20:25.973ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2682024-11-09T01:20:25.973ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2692024-11-09T01:20:25.973ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2702024-11-09T01:20:25.973ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2712024-11-09T01:20:26.117ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2722024-11-09T01:20:26.117ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ab413033-915c-42e6-846f-3f01a7447749 (zpool)
2732024-11-09T01:20:26.352ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7844080888539011897 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
2742024-11-09T01:20:26.352ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10775002322017477020 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
2752024-11-09T01:20:26.579ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
2762024-11-09T01:20:26.581ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813) file = sled-agent/src/probe_manager.rs:231 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
2772024-11-09T01:20:26.642ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }
2782024-11-09T01:20:26.650ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2792024-11-09T01:20:26.650ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2802024-11-09T01:20:26.650ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2812024-11-09T01:20:26.650ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2822024-11-09T01:20:26.650ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2832024-11-09T01:20:26.651ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2842024-11-09T01:20:26.651ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2852024-11-09T01:20:26.689ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2862024-11-09T01:20:26.697ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ab413033-915c-42e6-846f-3f01a7447749/crypt/zone file = sled-storage/src/dataset.rs:303
2872024-11-09T01:20:26.857ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ab413033-915c-42e6-846f-3f01a7447749 file = sled-storage/src/dataset.rs:389
2882024-11-09T01:20:26.864ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2892024-11-09T01:20:26.864ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2902024-11-09T01:20:26.864ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2912024-11-09T01:20:26.864ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2922024-11-09T01:20:26.864ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2932024-11-09T01:20:26.872ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2942024-11-09T01:20:26.872ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool)
2952024-11-09T01:20:26.961ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }
2962024-11-09T01:20:26.968ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
2972024-11-09T01:20:26.968ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
2982024-11-09T01:20:26.968ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
2992024-11-09T01:20:26.968ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
3002024-11-09T01:20:26.968ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3012024-11-09T01:20:26.968ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3022024-11-09T01:20:26.968ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3032024-11-09T01:20:26.999ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3042024-11-09T01:20:27.006ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1f0e3af0-a7d2-464f-9192-4fe81acc94c1/crypt/zone file = sled-storage/src/dataset.rs:303
3052024-11-09T01:20:27.174ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1f0e3af0-a7d2-464f-9192-4fe81acc94c1 file = sled-storage/src/dataset.rs:389
3062024-11-09T01:20:27.181ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3072024-11-09T01:20:27.181ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3082024-11-09T01:20:27.181ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3092024-11-09T01:20:27.181ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3102024-11-09T01:20:27.181ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3112024-11-09T01:20:27.190ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3122024-11-09T01:20:27.190ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool)
3132024-11-09T01:20:27.281ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }
3142024-11-09T01:20:27.288ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3152024-11-09T01:20:27.289ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3162024-11-09T01:20:27.289ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3172024-11-09T01:20:27.289ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3182024-11-09T01:20:27.289ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3192024-11-09T01:20:27.289ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3202024-11-09T01:20:27.289ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3212024-11-09T01:20:27.323ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3222024-11-09T01:20:27.331ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_dfa112e2-c0df-4b06-b74f-0a27df3ed293/crypt/zone file = sled-storage/src/dataset.rs:303
3232024-11-09T01:20:27.506ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_dfa112e2-c0df-4b06-b74f-0a27df3ed293 file = sled-storage/src/dataset.rs:389
3242024-11-09T01:20:27.514ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3252024-11-09T01:20:27.515ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3262024-11-09T01:20:27.515ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3272024-11-09T01:20:27.515ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3282024-11-09T01:20:27.515ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3292024-11-09T01:20:27.524ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3302024-11-09T01:20:27.524ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool)
3312024-11-09T01:20:27.621ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }
3322024-11-09T01:20:27.629ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3332024-11-09T01:20:27.629ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3342024-11-09T01:20:27.629ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3352024-11-09T01:20:27.629ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3362024-11-09T01:20:27.629ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3372024-11-09T01:20:27.629ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3382024-11-09T01:20:27.629ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3392024-11-09T01:20:27.633ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813) file = sled-agent/src/probe_manager.rs:231 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
3402024-11-09T01:20:27.664ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3412024-11-09T01:20:27.672ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ff1cdd93-8ce7-4ee1-845c-a77798315216/crypt/zone file = sled-storage/src/dataset.rs:303
3422024-11-09T01:20:27.849ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ff1cdd93-8ce7-4ee1-845c-a77798315216 file = sled-storage/src/dataset.rs:389
3432024-11-09T01:20:27.856ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3442024-11-09T01:20:27.856ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3452024-11-09T01:20:27.856ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3462024-11-09T01:20:27.856ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3472024-11-09T01:20:27.856ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3482024-11-09T01:20:27.866ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3492024-11-09T01:20:27.866ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool)
3502024-11-09T01:20:27.960ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }
3512024-11-09T01:20:27.968ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3522024-11-09T01:20:27.968ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3532024-11-09T01:20:27.968ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3542024-11-09T01:20:27.968ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3552024-11-09T01:20:27.968ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3562024-11-09T01:20:27.968ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3572024-11-09T01:20:27.968ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3582024-11-09T01:20:28.002ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3592024-11-09T01:20:28.011ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_fb3197ce-1650-4560-94ee-2bc866b44b0e/crypt/zone file = sled-storage/src/dataset.rs:303
3602024-11-09T01:20:28.190ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_fb3197ce-1650-4560-94ee-2bc866b44b0e file = sled-storage/src/dataset.rs:389
3612024-11-09T01:20:28.199ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3622024-11-09T01:20:28.199ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3632024-11-09T01:20:28.199ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3642024-11-09T01:20:28.199ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3652024-11-09T01:20:28.199ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3662024-11-09T01:20:28.209ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3672024-11-09T01:20:28.209ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool)
3682024-11-09T01:20:28.304ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External }
3692024-11-09T01:20:28.312ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3702024-11-09T01:20:28.312ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3712024-11-09T01:20:28.312ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3722024-11-09T01:20:28.312ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3732024-11-09T01:20:28.312ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3742024-11-09T01:20:28.312ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3752024-11-09T01:20:28.312ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3762024-11-09T01:20:28.348ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3772024-11-09T01:20:28.356ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3b61ae58-143a-47f2-a80d-e4aeb0c981fa/crypt/zone file = sled-storage/src/dataset.rs:303
3782024-11-09T01:20:28.529ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3b61ae58-143a-47f2-a80d-e4aeb0c981fa file = sled-storage/src/dataset.rs:389
3792024-11-09T01:20:28.537ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3802024-11-09T01:20:28.537ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3812024-11-09T01:20:28.537ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3822024-11-09T01:20:28.537ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3832024-11-09T01:20:28.538ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3842024-11-09T01:20:28.547ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3852024-11-09T01:20:28.547ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool)
3862024-11-09T01:20:28.639ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool), kind: External }
3872024-11-09T01:20:28.647ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3882024-11-09T01:20:28.647ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3892024-11-09T01:20:28.647ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3902024-11-09T01:20:28.647ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3912024-11-09T01:20:28.647ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3922024-11-09T01:20:28.648ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3932024-11-09T01:20:28.648ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3942024-11-09T01:20:28.651ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813) file = sled-agent/src/probe_manager.rs:231 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
3952024-11-09T01:20:28.687ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3962024-11-09T01:20:28.698ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3ddfa1e2-6686-49f9-839e-ea29e37a9969/crypt/zone file = sled-storage/src/dataset.rs:303
3972024-11-09T01:20:28.874ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3ddfa1e2-6686-49f9-839e-ea29e37a9969 file = sled-storage/src/dataset.rs:389
3982024-11-09T01:20:28.881ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3992024-11-09T01:20:28.881ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4002024-11-09T01:20:28.881ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4012024-11-09T01:20:28.881ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4022024-11-09T01:20:28.881ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4032024-11-09T01:20:28.890ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4042024-11-09T01:20:28.890ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 429a71c0-de37-4c29-9517-d34e0fdea40d (zpool)
4052024-11-09T01:20:29.002ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 429a71c0-de37-4c29-9517-d34e0fdea40d (zpool), kind: External }
4062024-11-09T01:20:29.010ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4072024-11-09T01:20:29.010ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4082024-11-09T01:20:29.010ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4092024-11-09T01:20:29.010ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4102024-11-09T01:20:29.010ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4112024-11-09T01:20:29.010ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4122024-11-09T01:20:29.010ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4132024-11-09T01:20:29.048ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4142024-11-09T01:20:29.057ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_429a71c0-de37-4c29-9517-d34e0fdea40d/crypt/zone file = sled-storage/src/dataset.rs:303
4152024-11-09T01:20:29.233ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_429a71c0-de37-4c29-9517-d34e0fdea40d file = sled-storage/src/dataset.rs:389
4162024-11-09T01:20:29.240ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4172024-11-09T01:20:29.240ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4182024-11-09T01:20:29.240ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4192024-11-09T01:20:29.240ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4202024-11-09T01:20:29.240ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4212024-11-09T01:20:29.250ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4222024-11-09T01:20:29.250ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = bf89547e-f293-4d7a-96c8-740a254cce2e (zpool)
4232024-11-09T01:20:29.347ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External }
4242024-11-09T01:20:29.355ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4252024-11-09T01:20:29.355ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4262024-11-09T01:20:29.355ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4272024-11-09T01:20:29.355ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4282024-11-09T01:20:29.355ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4292024-11-09T01:20:29.355ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4302024-11-09T01:20:29.355ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4312024-11-09T01:20:29.391ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4322024-11-09T01:20:29.398ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_bf89547e-f293-4d7a-96c8-740a254cce2e/crypt/zone file = sled-storage/src/dataset.rs:303
4332024-11-09T01:20:29.571ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_bf89547e-f293-4d7a-96c8-740a254cce2e file = sled-storage/src/dataset.rs:389
4342024-11-09T01:20:29.579ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4352024-11-09T01:20:29.579ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4362024-11-09T01:20:29.579ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4372024-11-09T01:20:29.579ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f925765a-5a42-4a3d-aa53-e9481c784b20 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8d8ef7b1-4af4-4c69-9e3f-98ca7b356569 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 429a71c0-de37-4c29-9517-d34e0fdea40d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4382024-11-09T01:20:29.579ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4392024-11-09T01:20:29.579ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4402024-11-09T01:20:29.579ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4412024-11-09T01:20:29.580ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:887 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
4422024-11-09T01:20:29.580ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4432024-11-09T01:20:29.580ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:913 generation = Generation(1) sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
4442024-11-09T01:20:29.580ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:918 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
4452024-11-09T01:20:29.580ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:923 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
4462024-11-09T01:20:29.580ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
4472024-11-09T01:20:29.580ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:929 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
4482024-11-09T01:20:29.580ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4492024-11-09T01:20:29.580ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:934 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
4502024-11-09T01:20:29.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3607364 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:57160 req_id = 2f29e961-b169-4d81-835b-ee2124bef24f response_code = 200 uri = /omicron-physical-disks
4512024-11-09T01:20:29.611ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {01e360d7-945e-45fe-9970-63be616959ea (dataset): DatasetConfig { id: 01e360d7-945e-45fe-9970-63be616959ea (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0c0dd137-186f-4988-ad82-12d309048182 (dataset): DatasetConfig { id: 0c0dd137-186f-4988-ad82-12d309048182 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0d395d57-57c2-4146-b476-d33f8ed72f56 (dataset): DatasetConfig { id: 0d395d57-57c2-4146-b476-d33f8ed72f56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e419c68-fbd7-46f9-bd49-b2b40e6790cc (dataset): DatasetConfig { id: 0e419c68-fbd7-46f9-bd49-b2b40e6790cc (dataset), name: DatasetName { pool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1170e495-4ed1-4b6b-a8f3-a2fd4a2ae82a (dataset): DatasetConfig { id: 1170e495-4ed1-4b6b-a8f3-a2fd4a2ae82a (dataset), name: DatasetName { pool_name: ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1272f03c-923f-4bcc-b828-2c0f362ca581 (dataset): DatasetConfig { id: 1272f03c-923f-4bcc-b828-2c0f362ca581 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 136442ad-79e3-4530-9a02-d2d1cfa5f99c (dataset): DatasetConfig { id: 136442ad-79e3-4530-9a02-d2d1cfa5f99c (dataset), name: DatasetName { pool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 13a0263f-f306-4449-ba3c-e4722a5b7a58 (dataset): DatasetConfig { id: 13a0263f-f306-4449-ba3c-e4722a5b7a58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1910b55b-3a40-4906-9ca4-2cd5690e2dba (dataset): DatasetConfig { id: 1910b55b-3a40-4906-9ca4-2cd5690e2dba (dataset), name: DatasetName { pool_name: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 19d9c105-5065-4aea-ab8b-c226f25338c0 (dataset): DatasetConfig { id: 19d9c105-5065-4aea-ab8b-c226f25338c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b2f3782-e45d-47c0-a7cd-8e5963065b2b (dataset): DatasetConfig { id: 1b2f3782-e45d-47c0-a7cd-8e5963065b2b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e00d7b3-2cf1-44db-a58c-72f223673089 (dataset): DatasetConfig { id: 1e00d7b3-2cf1-44db-a58c-72f223673089 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e229a60-d35c-4445-9097-67cfd0d0e3af (dataset): DatasetConfig { id: 1e229a60-d35c-4445-9097-67cfd0d0e3af (dataset), name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 21d987e6-6ecd-4e04-b640-d3abd33ed673 (dataset): DatasetConfig { id: 21d987e6-6ecd-4e04-b640-d3abd33ed673 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29b23638-b590-49b3-b7df-adb1f79e36c8 (dataset): DatasetConfig { id: 29b23638-b590-49b3-b7df-adb1f79e36c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 314c7159-b883-4ba6-8d46-11d0bb0b23c3 (dataset): DatasetConfig { id: 314c7159-b883-4ba6-8d46-11d0bb0b23c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3b2c66eb-ab55-4b5e-9ff8-5e1b127e8db8 (dataset): DatasetConfig { id: 3b2c66eb-ab55-4b5e-9ff8-5e1b127e8db8 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3c1330d9-c2a3-4118-9f7f-df89565f9d82 (dataset): DatasetConfig { id: 3c1330d9-c2a3-4118-9f7f-df89565f9d82 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e3adea0-48ea-4c58-96a8-05a7af7c871c (dataset): DatasetConfig { id: 3e3adea0-48ea-4c58-96a8-05a7af7c871c (dataset), name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3f7c351b-d132-485f-8efa-e7d2c23b467b (dataset): DatasetConfig { id: 3f7c351b-d132-485f-8efa-e7d2c23b467b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 415d345c-c76d-47ef-8d04-24f47d07d6ad (dataset): DatasetConfig { id: 415d345c-c76d-47ef-8d04-24f47d07d6ad (dataset), name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 446be0ac-72b2-4ce5-b3ce-8dd18b3bffd4 (dataset): DatasetConfig { id: 446be0ac-72b2-4ce5-b3ce-8dd18b3bffd4 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4656170d-acde-4368-9980-2b2f678ba6ec (dataset): DatasetConfig { id: 4656170d-acde-4368-9980-2b2f678ba6ec (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4cb239ba-6b6c-4466-85e4-8630b8342127 (dataset): DatasetConfig { id: 4cb239ba-6b6c-4466-85e4-8630b8342127 (dataset), name: DatasetName { pool_name: ZpoolName { id: 429a71c0-de37-4c29-9517-d34e0fdea40d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 53527c6c-92ea-4924-b8a3-45965a58e6e7 (dataset): DatasetConfig { id: 53527c6c-92ea-4924-b8a3-45965a58e6e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 55188a60-19c7-430c-8cd3-c8aaf5965c79 (dataset): DatasetConfig { id: 55188a60-19c7-430c-8cd3-c8aaf5965c79 (dataset), name: DatasetName { pool_name: ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5cf03238-aca3-4f56-ae1b-a5e5c5813659 (dataset): DatasetConfig { id: 5cf03238-aca3-4f56-ae1b-a5e5c5813659 (dataset), name: DatasetName { pool_name: ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5df99713-29df-45dc-bc7d-496513173f6e (dataset): DatasetConfig { id: 5df99713-29df-45dc-bc7d-496513173f6e (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 602aef62-b486-46b5-9a36-ebe0b54d9245 (dataset): DatasetConfig { id: 602aef62-b486-46b5-9a36-ebe0b54d9245 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 641214e9-f82d-4570-8897-c5cfb3b8cac0 (dataset): DatasetConfig { id: 641214e9-f82d-4570-8897-c5cfb3b8cac0 (dataset), name: DatasetName { pool_name: ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7377eee8-e854-4bd1-8661-eb25810c82c0 (dataset): DatasetConfig { id: 7377eee8-e854-4bd1-8661-eb25810c82c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 73bc02c2-cd61-4a55-9f39-e9ac5dd39f28 (dataset): DatasetConfig { id: 73bc02c2-cd61-4a55-9f39-e9ac5dd39f28 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a2268a7-e618-4795-a818-9024aa508664 (dataset): DatasetConfig { id: 7a2268a7-e618-4795-a818-9024aa508664 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7daf1146-31a1-4881-a8c2-3c92b6661780 (dataset): DatasetConfig { id: 7daf1146-31a1-4881-a8c2-3c92b6661780 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86889b0d-cfb3-4660-94ba-5c85aee0eef5 (dataset): DatasetConfig { id: 86889b0d-cfb3-4660-94ba-5c85aee0eef5 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86bd165b-ce00-4b52-b099-ff121c66cc88 (dataset): DatasetConfig { id: 86bd165b-ce00-4b52-b099-ff121c66cc88 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e022bbf-b954-41c2-9c4e-2760691eada6 (dataset): DatasetConfig { id: 8e022bbf-b954-41c2-9c4e-2760691eada6 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 90b47459-5b40-4350-8601-11566087534d (dataset): DatasetConfig { id: 90b47459-5b40-4350-8601-11566087534d (dataset), name: DatasetName { pool_name: ZpoolName { id: 429a71c0-de37-4c29-9517-d34e0fdea40d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9105db24-0e40-4e3a-954d-a866846b4933 (dataset): DatasetConfig { id: 9105db24-0e40-4e3a-954d-a866846b4933 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9f41b0cb-fc8f-4c7d-977f-414581633814 (dataset): DatasetConfig { id: 9f41b0cb-fc8f-4c7d-977f-414581633814 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a805eff4-3c88-48f7-9257-e0470448f131 (dataset): DatasetConfig { id: a805eff4-3c88-48f7-9257-e0470448f131 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, adc1a00a-4581-4004-9b2b-fe8659ff8864 (dataset): DatasetConfig { id: adc1a00a-4581-4004-9b2b-fe8659ff8864 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, af1d9c14-106b-454e-a7a3-d15f87333d77 (dataset): DatasetConfig { id: af1d9c14-106b-454e-a7a3-d15f87333d77 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, af4f6517-4efc-44f2-9e24-3030893ac87e (dataset): DatasetConfig { id: af4f6517-4efc-44f2-9e24-3030893ac87e (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b82a1239-f675-4733-8a1b-95a8cb711a86 (dataset): DatasetConfig { id: b82a1239-f675-4733-8a1b-95a8cb711a86 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc810868-68a3-4345-9ae8-2e696ade6a7c (dataset): DatasetConfig { id: bc810868-68a3-4345-9ae8-2e696ade6a7c (dataset), name: DatasetName { pool_name: ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bdcc2a2b-62e9-44d9-a6d0-7a6813ae04df (dataset): DatasetConfig { id: bdcc2a2b-62e9-44d9-a6d0-7a6813ae04df (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c7871f76-8780-4fc8-9922-d0ecda8bc80b (dataset): DatasetConfig { id: c7871f76-8780-4fc8-9922-d0ecda8bc80b (dataset), name: DatasetName { pool_name: ZpoolName { id: 429a71c0-de37-4c29-9517-d34e0fdea40d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d07e26ba-a4fe-4ea9-9782-5c9ef33073a1 (dataset): DatasetConfig { id: d07e26ba-a4fe-4ea9-9782-5c9ef33073a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d14e3b84-c3d5-4afa-bd2b-36f3db902bcc (dataset): DatasetConfig { id: d14e3b84-c3d5-4afa-bd2b-36f3db902bcc (dataset), name: DatasetName { pool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1bf417b-e6b2-45dc-8f32-5e169994a93d (dataset): DatasetConfig { id: d1bf417b-e6b2-45dc-8f32-5e169994a93d (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4248e42-7d99-4362-ae9c-5ffda2cecc84 (dataset): DatasetConfig { id: d4248e42-7d99-4362-ae9c-5ffda2cecc84 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d5a614c0-3feb-49c2-b139-35df6ec005cf (dataset): DatasetConfig { id: d5a614c0-3feb-49c2-b139-35df6ec005cf (dataset), name: DatasetName { pool_name: ZpoolName { id: 429a71c0-de37-4c29-9517-d34e0fdea40d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7bd2abc-b475-4d75-8cae-fedd29f2f577 (dataset): DatasetConfig { id: d7bd2abc-b475-4d75-8cae-fedd29f2f577 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d81072ef-bdca-4e9e-9560-c06d9a96e759 (dataset): DatasetConfig { id: d81072ef-bdca-4e9e-9560-c06d9a96e759 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, dbac4631-4799-4b3e-8cd0-197e9d2bf466 (dataset): DatasetConfig { id: dbac4631-4799-4b3e-8cd0-197e9d2bf466 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dfd7e5a6-89e9-4cbc-82cf-2fe4880d0c7a (dataset): DatasetConfig { id: dfd7e5a6-89e9-4cbc-82cf-2fe4880d0c7a (dataset), name: DatasetName { pool_name: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e3af8889-7b28-4bd1-9344-1cb800771d53 (dataset): DatasetConfig { id: e3af8889-7b28-4bd1-9344-1cb800771d53 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e50caec2-c391-4d49-a779-c6168db5adc1 (dataset): DatasetConfig { id: e50caec2-c391-4d49-a779-c6168db5adc1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6795449-b9b5-407a-b825-a75b8818cc38 (dataset): DatasetConfig { id: e6795449-b9b5-407a-b825-a75b8818cc38 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eeae1a7f-7172-4cd4-8c8b-7a3559162d6e (dataset): DatasetConfig { id: eeae1a7f-7172-4cd4-8c8b-7a3559162d6e (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f5a07eee-b97a-428b-a04e-ddcb3bd0b2e5 (dataset): DatasetConfig { id: f5a07eee-b97a-428b-a04e-ddcb3bd0b2e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f6b55a4c-c8da-4af2-9bae-794b0f8e9d91 (dataset): DatasetConfig { id: f6b55a4c-c8da-4af2-9bae-794b0f8e9d91 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f75b94e6-875a-4519-8614-60e2398cc586 (dataset): DatasetConfig { id: f75b94e6-875a-4519-8614-60e2398cc586 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f7e89997-43dd-4320-92c7-893a86fe84c7 (dataset): DatasetConfig { id: f7e89997-43dd-4320-92c7-893a86fe84c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fdb4f0a3-2ad0-45f7-b95b-7deded663df4 (dataset): DatasetConfig { id: fdb4f0a3-2ad0-45f7-b95b-7deded663df4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:457 sled_address = [fd00:1122:3344:101::1]:12345
4522024-11-09T01:20:29.611ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45909
4532024-11-09T01:20:29.612ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:849 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
4542024-11-09T01:20:29.612ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {01e360d7-945e-45fe-9970-63be616959ea (dataset): DatasetConfig { id: 01e360d7-945e-45fe-9970-63be616959ea (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0c0dd137-186f-4988-ad82-12d309048182 (dataset): DatasetConfig { id: 0c0dd137-186f-4988-ad82-12d309048182 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0d395d57-57c2-4146-b476-d33f8ed72f56 (dataset): DatasetConfig { id: 0d395d57-57c2-4146-b476-d33f8ed72f56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e419c68-fbd7-46f9-bd49-b2b40e6790cc (dataset): DatasetConfig { id: 0e419c68-fbd7-46f9-bd49-b2b40e6790cc (dataset), name: DatasetName { pool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1170e495-4ed1-4b6b-a8f3-a2fd4a2ae82a (dataset): DatasetConfig { id: 1170e495-4ed1-4b6b-a8f3-a2fd4a2ae82a (dataset), name: DatasetName { pool_name: ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1272f03c-923f-4bcc-b828-2c0f362ca581 (dataset): DatasetConfig { id: 1272f03c-923f-4bcc-b828-2c0f362ca581 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 136442ad-79e3-4530-9a02-d2d1cfa5f99c (dataset): DatasetConfig { id: 136442ad-79e3-4530-9a02-d2d1cfa5f99c (dataset), name: DatasetName { pool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 13a0263f-f306-4449-ba3c-e4722a5b7a58 (dataset): DatasetConfig { id: 13a0263f-f306-4449-ba3c-e4722a5b7a58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1910b55b-3a40-4906-9ca4-2cd5690e2dba (dataset): DatasetConfig { id: 1910b55b-3a40-4906-9ca4-2cd5690e2dba (dataset), name: DatasetName { pool_name: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 19d9c105-5065-4aea-ab8b-c226f25338c0 (dataset): DatasetConfig { id: 19d9c105-5065-4aea-ab8b-c226f25338c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b2f3782-e45d-47c0-a7cd-8e5963065b2b (dataset): DatasetConfig { id: 1b2f3782-e45d-47c0-a7cd-8e5963065b2b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e00d7b3-2cf1-44db-a58c-72f223673089 (dataset): DatasetConfig { id: 1e00d7b3-2cf1-44db-a58c-72f223673089 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e229a60-d35c-4445-9097-67cfd0d0e3af (dataset): DatasetConfig { id: 1e229a60-d35c-4445-9097-67cfd0d0e3af (dataset), name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 21d987e6-6ecd-4e04-b640-d3abd33ed673 (dataset): DatasetConfig { id: 21d987e6-6ecd-4e04-b640-d3abd33ed673 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29b23638-b590-49b3-b7df-adb1f79e36c8 (dataset): DatasetConfig { id: 29b23638-b590-49b3-b7df-adb1f79e36c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 314c7159-b883-4ba6-8d46-11d0bb0b23c3 (dataset): DatasetConfig { id: 314c7159-b883-4ba6-8d46-11d0bb0b23c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3b2c66eb-ab55-4b5e-9ff8-5e1b127e8db8 (dataset): DatasetConfig { id: 3b2c66eb-ab55-4b5e-9ff8-5e1b127e8db8 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3c1330d9-c2a3-4118-9f7f-df89565f9d82 (dataset): DatasetConfig { id: 3c1330d9-c2a3-4118-9f7f-df89565f9d82 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e3adea0-48ea-4c58-96a8-05a7af7c871c (dataset): DatasetConfig { id: 3e3adea0-48ea-4c58-96a8-05a7af7c871c (dataset), name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3f7c351b-d132-485f-8efa-e7d2c23b467b (dataset): DatasetConfig { id: 3f7c351b-d132-485f-8efa-e7d2c23b467b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 415d345c-c76d-47ef-8d04-24f47d07d6ad (dataset): DatasetConfig { id: 415d345c-c76d-47ef-8d04-24f47d07d6ad (dataset), name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 446be0ac-72b2-4ce5-b3ce-8dd18b3bffd4 (dataset): DatasetConfig { id: 446be0ac-72b2-4ce5-b3ce-8dd18b3bffd4 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4656170d-acde-4368-9980-2b2f678ba6ec (dataset): DatasetConfig { id: 4656170d-acde-4368-9980-2b2f678ba6ec (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4cb239ba-6b6c-4466-85e4-8630b8342127 (dataset): DatasetConfig { id: 4cb239ba-6b6c-4466-85e4-8630b8342127 (dataset), name: DatasetName { pool_name: ZpoolName { id: 429a71c0-de37-4c29-9517-d34e0fdea40d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 53527c6c-92ea-4924-b8a3-45965a58e6e7 (dataset): DatasetConfig { id: 53527c6c-92ea-4924-b8a3-45965a58e6e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 55188a60-19c7-430c-8cd3-c8aaf5965c79 (dataset): DatasetConfig { id: 55188a60-19c7-430c-8cd3-c8aaf5965c79 (dataset), name: DatasetName { pool_name: ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5cf03238-aca3-4f56-ae1b-a5e5c5813659 (dataset): DatasetConfig { id: 5cf03238-aca3-4f56-ae1b-a5e5c5813659 (dataset), name: DatasetName { pool_name: ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5df99713-29df-45dc-bc7d-496513173f6e (dataset): DatasetConfig { id: 5df99713-29df-45dc-bc7d-496513173f6e (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 602aef62-b486-46b5-9a36-ebe0b54d9245 (dataset): DatasetConfig { id: 602aef62-b486-46b5-9a36-ebe0b54d9245 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 641214e9-f82d-4570-8897-c5cfb3b8cac0 (dataset): DatasetConfig { id: 641214e9-f82d-4570-8897-c5cfb3b8cac0 (dataset), name: DatasetName { pool_name: ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7377eee8-e854-4bd1-8661-eb25810c82c0 (dataset): DatasetConfig { id: 7377eee8-e854-4bd1-8661-eb25810c82c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 73bc02c2-cd61-4a55-9f39-e9ac5dd39f28 (dataset): DatasetConfig { id: 73bc02c2-cd61-4a55-9f39-e9ac5dd39f28 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a2268a7-e618-4795-a818-9024aa508664 (dataset): DatasetConfig { id: 7a2268a7-e618-4795-a818-9024aa508664 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7daf1146-31a1-4881-a8c2-3c92b6661780 (dataset): DatasetConfig { id: 7daf1146-31a1-4881-a8c2-3c92b6661780 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86889b0d-cfb3-4660-94ba-5c85aee0eef5 (dataset): DatasetConfig { id: 86889b0d-cfb3-4660-94ba-5c85aee0eef5 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86bd165b-ce00-4b52-b099-ff121c66cc88 (dataset): DatasetConfig { id: 86bd165b-ce00-4b52-b099-ff121c66cc88 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e022bbf-b954-41c2-9c4e-2760691eada6 (dataset): DatasetConfig { id: 8e022bbf-b954-41c2-9c4e-2760691eada6 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 90b47459-5b40-4350-8601-11566087534d (dataset): DatasetConfig { id: 90b47459-5b40-4350-8601-11566087534d (dataset), name: DatasetName { pool_name: ZpoolName { id: 429a71c0-de37-4c29-9517-d34e0fdea40d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9105db24-0e40-4e3a-954d-a866846b4933 (dataset): DatasetConfig { id: 9105db24-0e40-4e3a-954d-a866846b4933 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9f41b0cb-fc8f-4c7d-977f-414581633814 (dataset): DatasetConfig { id: 9f41b0cb-fc8f-4c7d-977f-414581633814 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a805eff4-3c88-48f7-9257-e0470448f131 (dataset): DatasetConfig { id: a805eff4-3c88-48f7-9257-e0470448f131 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, adc1a00a-4581-4004-9b2b-fe8659ff8864 (dataset): DatasetConfig { id: adc1a00a-4581-4004-9b2b-fe8659ff8864 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, af1d9c14-106b-454e-a7a3-d15f87333d77 (dataset): DatasetConfig { id: af1d9c14-106b-454e-a7a3-d15f87333d77 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, af4f6517-4efc-44f2-9e24-3030893ac87e (dataset): DatasetConfig { id: af4f6517-4efc-44f2-9e24-3030893ac87e (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b82a1239-f675-4733-8a1b-95a8cb711a86 (dataset): DatasetConfig { id: b82a1239-f675-4733-8a1b-95a8cb711a86 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc810868-68a3-4345-9ae8-2e696ade6a7c (dataset): DatasetConfig { id: bc810868-68a3-4345-9ae8-2e696ade6a7c (dataset), name: DatasetName { pool_name: ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bdcc2a2b-62e9-44d9-a6d0-7a6813ae04df (dataset): DatasetConfig { id: bdcc2a2b-62e9-44d9-a6d0-7a6813ae04df (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c7871f76-8780-4fc8-9922-d0ecda8bc80b (dataset): DatasetConfig { id: c7871f76-8780-4fc8-9922-d0ecda8bc80b (dataset), name: DatasetName { pool_name: ZpoolName { id: 429a71c0-de37-4c29-9517-d34e0fdea40d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d07e26ba-a4fe-4ea9-9782-5c9ef33073a1 (dataset): DatasetConfig { id: d07e26ba-a4fe-4ea9-9782-5c9ef33073a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d14e3b84-c3d5-4afa-bd2b-36f3db902bcc (dataset): DatasetConfig { id: d14e3b84-c3d5-4afa-bd2b-36f3db902bcc (dataset), name: DatasetName { pool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1bf417b-e6b2-45dc-8f32-5e169994a93d (dataset): DatasetConfig { id: d1bf417b-e6b2-45dc-8f32-5e169994a93d (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4248e42-7d99-4362-ae9c-5ffda2cecc84 (dataset): DatasetConfig { id: d4248e42-7d99-4362-ae9c-5ffda2cecc84 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d5a614c0-3feb-49c2-b139-35df6ec005cf (dataset): DatasetConfig { id: d5a614c0-3feb-49c2-b139-35df6ec005cf (dataset), name: DatasetName { pool_name: ZpoolName { id: 429a71c0-de37-4c29-9517-d34e0fdea40d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7bd2abc-b475-4d75-8cae-fedd29f2f577 (dataset): DatasetConfig { id: d7bd2abc-b475-4d75-8cae-fedd29f2f577 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d81072ef-bdca-4e9e-9560-c06d9a96e759 (dataset): DatasetConfig { id: d81072ef-bdca-4e9e-9560-c06d9a96e759 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, dbac4631-4799-4b3e-8cd0-197e9d2bf466 (dataset): DatasetConfig { id: dbac4631-4799-4b3e-8cd0-197e9d2bf466 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dfd7e5a6-89e9-4cbc-82cf-2fe4880d0c7a (dataset): DatasetConfig { id: dfd7e5a6-89e9-4cbc-82cf-2fe4880d0c7a (dataset), name: DatasetName { pool_name: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e3af8889-7b28-4bd1-9344-1cb800771d53 (dataset): DatasetConfig { id: e3af8889-7b28-4bd1-9344-1cb800771d53 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e50caec2-c391-4d49-a779-c6168db5adc1 (dataset): DatasetConfig { id: e50caec2-c391-4d49-a779-c6168db5adc1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6795449-b9b5-407a-b825-a75b8818cc38 (dataset): DatasetConfig { id: e6795449-b9b5-407a-b825-a75b8818cc38 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eeae1a7f-7172-4cd4-8c8b-7a3559162d6e (dataset): DatasetConfig { id: eeae1a7f-7172-4cd4-8c8b-7a3559162d6e (dataset), name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f5a07eee-b97a-428b-a04e-ddcb3bd0b2e5 (dataset): DatasetConfig { id: f5a07eee-b97a-428b-a04e-ddcb3bd0b2e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f6b55a4c-c8da-4af2-9bae-794b0f8e9d91 (dataset): DatasetConfig { id: f6b55a4c-c8da-4af2-9bae-794b0f8e9d91 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f75b94e6-875a-4519-8614-60e2398cc586 (dataset): DatasetConfig { id: f75b94e6-875a-4519-8614-60e2398cc586 (dataset), name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f7e89997-43dd-4320-92c7-893a86fe84c7 (dataset): DatasetConfig { id: f7e89997-43dd-4320-92c7-893a86fe84c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fdb4f0a3-2ad0-45f7-b95b-7deded663df4 (dataset): DatasetConfig { id: fdb4f0a3-2ad0-45f7-b95b-7deded663df4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4552024-11-09T01:20:29.612ZINFOSledAgent (StorageManager): No ledger in /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4562024-11-09T01:20:29.612ZINFOSledAgent (StorageManager): No ledger in /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4572024-11-09T01:20:29.612ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4582024-11-09T01:20:29.612ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4592024-11-09T01:20:29.612ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ab413033-915c-42e6-846f-3f01a7447749/crypt/debug"), full_name: "oxp_ab413033-915c-42e6-846f-3f01a7447749/crypt/debug" } file = sled-storage/src/manager.rs:1331
4602024-11-09T01:20:29.654ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813) file = sled-agent/src/probe_manager.rs:231 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
4612024-11-09T01:20:29.679ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4622024-11-09T01:20:29.679ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1f0e3af0-a7d2-464f-9192-4fe81acc94c1/crypt/debug"), full_name: "oxp_1f0e3af0-a7d2-464f-9192-4fe81acc94c1/crypt/debug" } file = sled-storage/src/manager.rs:1331
4632024-11-09T01:20:29.744ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4642024-11-09T01:20:29.744ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3ddfa1e2-6686-49f9-839e-ea29e37a9969/crypt/zone/oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940"), full_name: "oxp_3ddfa1e2-6686-49f9-839e-ea29e37a9969/crypt/zone/oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940" } file = sled-storage/src/manager.rs:1331
4652024-11-09T01:20:29.747ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 11.518026688s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
4662024-11-09T01:20:29.841ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4672024-11-09T01:20:29.841ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ff1cdd93-8ce7-4ee1-845c-a77798315216/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4682024-11-09T01:20:29.929ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4692024-11-09T01:20:29.929ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bf89547e-f293-4d7a-96c8-740a254cce2e/crypt/zone/oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371"), full_name: "oxp_bf89547e-f293-4d7a-96c8-740a254cce2e/crypt/zone/oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371" } file = sled-storage/src/manager.rs:1331
4702024-11-09T01:20:30.026ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4712024-11-09T01:20:30.026ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fb3197ce-1650-4560-94ee-2bc866b44b0e/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4722024-11-09T01:20:30.116ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4732024-11-09T01:20:30.116ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ff1cdd93-8ce7-4ee1-845c-a77798315216/crypt/zone/oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357"), full_name: "oxp_ff1cdd93-8ce7-4ee1-845c-a77798315216/crypt/zone/oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357" } file = sled-storage/src/manager.rs:1331
4742024-11-09T01:20:30.217ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4752024-11-09T01:20:30.217ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3b61ae58-143a-47f2-a80d-e4aeb0c981fa/crypt/debug"), full_name: "oxp_3b61ae58-143a-47f2-a80d-e4aeb0c981fa/crypt/debug" } file = sled-storage/src/manager.rs:1331
4762024-11-09T01:20:30.284ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4772024-11-09T01:20:30.284ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb3197ce-1650-4560-94ee-2bc866b44b0e/crypt/zone/oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5"), full_name: "oxp_fb3197ce-1650-4560-94ee-2bc866b44b0e/crypt/zone/oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5" } file = sled-storage/src/manager.rs:1331
4782024-11-09T01:20:30.384ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4792024-11-09T01:20:30.384ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dfa112e2-c0df-4b06-b74f-0a27df3ed293/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
4802024-11-09T01:20:30.473ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4812024-11-09T01:20:30.473ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3b61ae58-143a-47f2-a80d-e4aeb0c981fa/crypt/zone"), full_name: "oxp_3b61ae58-143a-47f2-a80d-e4aeb0c981fa/crypt/zone" } file = sled-storage/src/manager.rs:1331
4822024-11-09T01:20:30.540ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4832024-11-09T01:20:30.540ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ab413033-915c-42e6-846f-3f01a7447749/crypt/zone/oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9"), full_name: "oxp_ab413033-915c-42e6-846f-3f01a7447749/crypt/zone/oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9" } file = sled-storage/src/manager.rs:1331
4842024-11-09T01:20:30.638ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4852024-11-09T01:20:30.638ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dfa112e2-c0df-4b06-b74f-0a27df3ed293/crypt/zone/oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2"), full_name: "oxp_dfa112e2-c0df-4b06-b74f-0a27df3ed293/crypt/zone/oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2" } file = sled-storage/src/manager.rs:1331
4862024-11-09T01:20:30.656ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813) file = sled-agent/src/probe_manager.rs:231 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
4872024-11-09T01:20:30.741ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4882024-11-09T01:20:30.741ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1f0e3af0-a7d2-464f-9192-4fe81acc94c1/crucible" } file = sled-storage/src/manager.rs:1331
4892024-11-09T01:20:30.833ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4902024-11-09T01:20:30.833ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1f0e3af0-a7d2-464f-9192-4fe81acc94c1/crypt/zone/oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0"), full_name: "oxp_1f0e3af0-a7d2-464f-9192-4fe81acc94c1/crypt/zone/oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0" } file = sled-storage/src/manager.rs:1331
4912024-11-09T01:20:30.934ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4922024-11-09T01:20:30.934ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ab413033-915c-42e6-846f-3f01a7447749/crypt/zone/oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265"), full_name: "oxp_ab413033-915c-42e6-846f-3f01a7447749/crypt/zone/oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265" } file = sled-storage/src/manager.rs:1331
4932024-11-09T01:20:31.035ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4942024-11-09T01:20:31.035ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dfa112e2-c0df-4b06-b74f-0a27df3ed293/crucible" } file = sled-storage/src/manager.rs:1331
4952024-11-09T01:20:31.125ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4962024-11-09T01:20:31.125ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ab413033-915c-42e6-846f-3f01a7447749/crucible" } file = sled-storage/src/manager.rs:1331
4972024-11-09T01:20:31.214ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4982024-11-09T01:20:31.214ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dfa112e2-c0df-4b06-b74f-0a27df3ed293/crypt/debug"), full_name: "oxp_dfa112e2-c0df-4b06-b74f-0a27df3ed293/crypt/debug" } file = sled-storage/src/manager.rs:1331
4992024-11-09T01:20:31.282ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5002024-11-09T01:20:31.282ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3ddfa1e2-6686-49f9-839e-ea29e37a9969/crucible" } file = sled-storage/src/manager.rs:1331
5012024-11-09T01:20:31.372ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5022024-11-09T01:20:31.372ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dfa112e2-c0df-4b06-b74f-0a27df3ed293/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5032024-11-09T01:20:31.461ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5042024-11-09T01:20:31.461ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ab413033-915c-42e6-846f-3f01a7447749/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5052024-11-09T01:20:31.550ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5062024-11-09T01:20:31.551ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1f0e3af0-a7d2-464f-9192-4fe81acc94c1/crypt/zone/oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a"), full_name: "oxp_1f0e3af0-a7d2-464f-9192-4fe81acc94c1/crypt/zone/oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a" } file = sled-storage/src/manager.rs:1331
5072024-11-09T01:20:31.649ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5082024-11-09T01:20:31.649ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/429a71c0-de37-4c29-9517-d34e0fdea40d/crypt/debug"), full_name: "oxp_429a71c0-de37-4c29-9517-d34e0fdea40d/crypt/debug" } file = sled-storage/src/manager.rs:1331
5092024-11-09T01:20:31.661ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813) file = sled-agent/src/probe_manager.rs:231 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
5102024-11-09T01:20:31.718ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5112024-11-09T01:20:31.718ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ab413033-915c-42e6-846f-3f01a7447749/crypt/zone"), full_name: "oxp_ab413033-915c-42e6-846f-3f01a7447749/crypt/zone" } file = sled-storage/src/manager.rs:1331
5122024-11-09T01:20:31.786ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5132024-11-09T01:20:31.786ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bf89547e-f293-4d7a-96c8-740a254cce2e/crypt/zone/oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d"), full_name: "oxp_bf89547e-f293-4d7a-96c8-740a254cce2e/crypt/zone/oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d" } file = sled-storage/src/manager.rs:1331
5142024-11-09T01:20:31.885ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5152024-11-09T01:20:31.885ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bf89547e-f293-4d7a-96c8-740a254cce2e/crypt/zone"), full_name: "oxp_bf89547e-f293-4d7a-96c8-740a254cce2e/crypt/zone" } file = sled-storage/src/manager.rs:1331
5162024-11-09T01:20:31.953ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5172024-11-09T01:20:31.953ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ab413033-915c-42e6-846f-3f01a7447749/crypt/zone/oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6"), full_name: "oxp_ab413033-915c-42e6-846f-3f01a7447749/crypt/zone/oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6" } file = sled-storage/src/manager.rs:1331
5182024-11-09T01:20:32.054ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5192024-11-09T01:20:32.054ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1f0e3af0-a7d2-464f-9192-4fe81acc94c1/crypt/zone/oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db"), full_name: "oxp_1f0e3af0-a7d2-464f-9192-4fe81acc94c1/crypt/zone/oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db" } file = sled-storage/src/manager.rs:1331
5202024-11-09T01:20:32.156ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5212024-11-09T01:20:32.156ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bf89547e-f293-4d7a-96c8-740a254cce2e/crypt/debug"), full_name: "oxp_bf89547e-f293-4d7a-96c8-740a254cce2e/crypt/debug" } file = sled-storage/src/manager.rs:1331
5222024-11-09T01:20:32.225ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5232024-11-09T01:20:32.225ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ab413033-915c-42e6-846f-3f01a7447749/crypt/zone/oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee"), full_name: "oxp_ab413033-915c-42e6-846f-3f01a7447749/crypt/zone/oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee" } file = sled-storage/src/manager.rs:1331
5242024-11-09T01:20:32.327ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5252024-11-09T01:20:32.327ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1f0e3af0-a7d2-464f-9192-4fe81acc94c1/crypt/zone"), full_name: "oxp_1f0e3af0-a7d2-464f-9192-4fe81acc94c1/crypt/zone" } file = sled-storage/src/manager.rs:1331
5262024-11-09T01:20:32.396ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5272024-11-09T01:20:32.396ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1f0e3af0-a7d2-464f-9192-4fe81acc94c1/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5282024-11-09T01:20:32.486ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5292024-11-09T01:20:32.486ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb3197ce-1650-4560-94ee-2bc866b44b0e/crypt/zone/oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1"), full_name: "oxp_fb3197ce-1650-4560-94ee-2bc866b44b0e/crypt/zone/oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1" } file = sled-storage/src/manager.rs:1331
5302024-11-09T01:20:32.585ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5312024-11-09T01:20:32.585ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ab413033-915c-42e6-846f-3f01a7447749/crypt/zone/oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b"), full_name: "oxp_ab413033-915c-42e6-846f-3f01a7447749/crypt/zone/oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b" } file = sled-storage/src/manager.rs:1331
5322024-11-09T01:20:32.663ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813) file = sled-agent/src/probe_manager.rs:231 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
5332024-11-09T01:20:32.685ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5342024-11-09T01:20:32.685ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3ddfa1e2-6686-49f9-839e-ea29e37a9969/crypt/zone"), full_name: "oxp_3ddfa1e2-6686-49f9-839e-ea29e37a9969/crypt/zone" } file = sled-storage/src/manager.rs:1331
5352024-11-09T01:20:32.757ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5362024-11-09T01:20:32.757ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ab413033-915c-42e6-846f-3f01a7447749/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
5372024-11-09T01:20:32.845ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5382024-11-09T01:20:32.845ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_429a71c0-de37-4c29-9517-d34e0fdea40d/crucible" } file = sled-storage/src/manager.rs:1331
5392024-11-09T01:20:32.935ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5402024-11-09T01:20:32.935ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dfa112e2-c0df-4b06-b74f-0a27df3ed293/crypt/zone/oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36"), full_name: "oxp_dfa112e2-c0df-4b06-b74f-0a27df3ed293/crypt/zone/oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36" } file = sled-storage/src/manager.rs:1331
5412024-11-09T01:20:33.033ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5422024-11-09T01:20:33.033ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ff1cdd93-8ce7-4ee1-845c-a77798315216/crypt/debug"), full_name: "oxp_ff1cdd93-8ce7-4ee1-845c-a77798315216/crypt/debug" } file = sled-storage/src/manager.rs:1331
5432024-11-09T01:20:33.102ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5442024-11-09T01:20:33.102ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dfa112e2-c0df-4b06-b74f-0a27df3ed293/crypt/zone/oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7"), full_name: "oxp_dfa112e2-c0df-4b06-b74f-0a27df3ed293/crypt/zone/oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7" } file = sled-storage/src/manager.rs:1331
5452024-11-09T01:20:33.202ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5462024-11-09T01:20:33.202ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3ddfa1e2-6686-49f9-839e-ea29e37a9969/crypt/debug"), full_name: "oxp_3ddfa1e2-6686-49f9-839e-ea29e37a9969/crypt/debug" } file = sled-storage/src/manager.rs:1331
5472024-11-09T01:20:33.270ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5482024-11-09T01:20:33.270ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ff1cdd93-8ce7-4ee1-845c-a77798315216/crypt/zone"), full_name: "oxp_ff1cdd93-8ce7-4ee1-845c-a77798315216/crypt/zone" } file = sled-storage/src/manager.rs:1331
5492024-11-09T01:20:33.341ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5502024-11-09T01:20:33.341ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3b61ae58-143a-47f2-a80d-e4aeb0c981fa/crypt/zone/oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194"), full_name: "oxp_3b61ae58-143a-47f2-a80d-e4aeb0c981fa/crypt/zone/oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194" } file = sled-storage/src/manager.rs:1331
5512024-11-09T01:20:33.440ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5522024-11-09T01:20:33.440ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1f0e3af0-a7d2-464f-9192-4fe81acc94c1/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5532024-11-09T01:20:33.531ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5542024-11-09T01:20:33.531ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_bf89547e-f293-4d7a-96c8-740a254cce2e/crucible" } file = sled-storage/src/manager.rs:1331
5552024-11-09T01:20:33.619ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5562024-11-09T01:20:33.619ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ab413033-915c-42e6-846f-3f01a7447749/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5572024-11-09T01:20:33.666ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813) file = sled-agent/src/probe_manager.rs:231 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
5582024-11-09T01:20:33.711ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5592024-11-09T01:20:33.711ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/429a71c0-de37-4c29-9517-d34e0fdea40d/crypt/zone/oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5"), full_name: "oxp_429a71c0-de37-4c29-9517-d34e0fdea40d/crypt/zone/oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5" } file = sled-storage/src/manager.rs:1331
5602024-11-09T01:20:33.809ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5612024-11-09T01:20:33.809ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1f0e3af0-a7d2-464f-9192-4fe81acc94c1/crypt/zone/oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68"), full_name: "oxp_1f0e3af0-a7d2-464f-9192-4fe81acc94c1/crypt/zone/oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68" } file = sled-storage/src/manager.rs:1331
5622024-11-09T01:20:33.907ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5632024-11-09T01:20:33.907ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ff1cdd93-8ce7-4ee1-845c-a77798315216/crucible" } file = sled-storage/src/manager.rs:1331
5642024-11-09T01:20:34.018ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5652024-11-09T01:20:34.019ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3b61ae58-143a-47f2-a80d-e4aeb0c981fa/crypt/zone/oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf"), full_name: "oxp_3b61ae58-143a-47f2-a80d-e4aeb0c981fa/crypt/zone/oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf" } file = sled-storage/src/manager.rs:1331
5662024-11-09T01:20:34.129ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5672024-11-09T01:20:34.129ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3b61ae58-143a-47f2-a80d-e4aeb0c981fa/crypt/zone/oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b"), full_name: "oxp_3b61ae58-143a-47f2-a80d-e4aeb0c981fa/crypt/zone/oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b" } file = sled-storage/src/manager.rs:1331
5682024-11-09T01:20:34.232ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5692024-11-09T01:20:34.232ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/429a71c0-de37-4c29-9517-d34e0fdea40d/crypt/zone"), full_name: "oxp_429a71c0-de37-4c29-9517-d34e0fdea40d/crypt/zone" } file = sled-storage/src/manager.rs:1331
5702024-11-09T01:20:34.301ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5712024-11-09T01:20:34.301ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ab413033-915c-42e6-846f-3f01a7447749/crypt/zone/oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c"), full_name: "oxp_ab413033-915c-42e6-846f-3f01a7447749/crypt/zone/oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c" } file = sled-storage/src/manager.rs:1331
5722024-11-09T01:20:34.401ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5732024-11-09T01:20:34.401ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb3197ce-1650-4560-94ee-2bc866b44b0e/crypt/debug"), full_name: "oxp_fb3197ce-1650-4560-94ee-2bc866b44b0e/crypt/debug" } file = sled-storage/src/manager.rs:1331
5742024-11-09T01:20:34.470ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5752024-11-09T01:20:34.470ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ff1cdd93-8ce7-4ee1-845c-a77798315216/crypt/zone/oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db"), full_name: "oxp_ff1cdd93-8ce7-4ee1-845c-a77798315216/crypt/zone/oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db" } file = sled-storage/src/manager.rs:1331
5762024-11-09T01:20:34.573ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5772024-11-09T01:20:34.573ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb3197ce-1650-4560-94ee-2bc866b44b0e/crypt/zone"), full_name: "oxp_fb3197ce-1650-4560-94ee-2bc866b44b0e/crypt/zone" } file = sled-storage/src/manager.rs:1331
5782024-11-09T01:20:34.640ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5792024-11-09T01:20:34.641ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dfa112e2-c0df-4b06-b74f-0a27df3ed293/crypt/zone/oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492"), full_name: "oxp_dfa112e2-c0df-4b06-b74f-0a27df3ed293/crypt/zone/oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492" } file = sled-storage/src/manager.rs:1331
5802024-11-09T01:20:34.668ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813) file = sled-agent/src/probe_manager.rs:231 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
5812024-11-09T01:20:34.741ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5822024-11-09T01:20:34.741ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3b61ae58-143a-47f2-a80d-e4aeb0c981fa/crucible" } file = sled-storage/src/manager.rs:1331
5832024-11-09T01:20:34.843ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5842024-11-09T01:20:34.843ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1f0e3af0-a7d2-464f-9192-4fe81acc94c1/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5852024-11-09T01:20:34.934ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5862024-11-09T01:20:34.934ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ab413033-915c-42e6-846f-3f01a7447749/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5872024-11-09T01:20:35.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5882024-11-09T01:20:35.022ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3ddfa1e2-6686-49f9-839e-ea29e37a9969/crypt/zone/oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9"), full_name: "oxp_3ddfa1e2-6686-49f9-839e-ea29e37a9969/crypt/zone/oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9" } file = sled-storage/src/manager.rs:1331
5892024-11-09T01:20:35.122ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5902024-11-09T01:20:35.122ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ff1cdd93-8ce7-4ee1-845c-a77798315216/crypt/zone/oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e"), full_name: "oxp_ff1cdd93-8ce7-4ee1-845c-a77798315216/crypt/zone/oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e" } file = sled-storage/src/manager.rs:1331
5912024-11-09T01:20:35.221ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5922024-11-09T01:20:35.221ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dfa112e2-c0df-4b06-b74f-0a27df3ed293/crypt/zone"), full_name: "oxp_dfa112e2-c0df-4b06-b74f-0a27df3ed293/crypt/zone" } file = sled-storage/src/manager.rs:1331
5932024-11-09T01:20:35.229ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
5942024-11-09T01:20:35.229ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
5952024-11-09T01:20:35.236ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
5962024-11-09T01:20:35.236ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
5972024-11-09T01:20:35.303ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5982024-11-09T01:20:35.303ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fb3197ce-1650-4560-94ee-2bc866b44b0e/crucible" } file = sled-storage/src/manager.rs:1331
5992024-11-09T01:20:35.388ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10140927342222296208 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
6002024-11-09T01:20:35.389ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8384839939087239612 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
6012024-11-09T01:20:35.392ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
6022024-11-09T01:20:35.392ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
6032024-11-09T01:20:35.411ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6042024-11-09T01:20:35.411ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1f0e3af0-a7d2-464f-9192-4fe81acc94c1/crypt/zone/oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c"), full_name: "oxp_1f0e3af0-a7d2-464f-9192-4fe81acc94c1/crypt/zone/oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c" } file = sled-storage/src/manager.rs:1331
6052024-11-09T01:20:35.434ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
6062024-11-09T01:20:35.434ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
6072024-11-09T01:20:35.487ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
6082024-11-09T01:20:35.487ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
6092024-11-09T01:20:35.511ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
6102024-11-09T01:20:35.511ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
6112024-11-09T01:20:35.523ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6122024-11-09T01:20:35.523ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6132024-11-09T01:20:35.524ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:851 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
6142024-11-09T01:20:35.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5912657 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:45909 req_id = 3ef6e35b-5fd6-424c-b9c5-8085c0c77be0 response_code = 200 uri = /datasets
6152024-11-09T01:20:35.568ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: d55caa1f-cc37-4ecb-b8bf-58b9052db1d9 (service), filesystem_pool: Some(ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 30d356ab-a881-4ca3-8f43-203be0381a68 (service), filesystem_pool: Some(ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2 (service), filesystem_pool: Some(ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
6162024-11-09T01:20:35.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53778
6172024-11-09T01:20:35.571ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d55caa1f-cc37-4ecb-b8bf-58b9052db1d9, dataset_name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6182024-11-09T01:20:35.571ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d55caa1f-cc37-4ecb-b8bf-58b9052db1d9, dataset_name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6192024-11-09T01:20:35.577ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
6202024-11-09T01:20:35.577ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
6212024-11-09T01:20:35.608ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 30d356ab-a881-4ca3-8f43-203be0381a68, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6222024-11-09T01:20:35.608ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 30d356ab-a881-4ca3-8f43-203be0381a68, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6232024-11-09T01:20:35.641ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2, dataset_name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6242024-11-09T01:20:35.641ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2, dataset_name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6252024-11-09T01:20:35.671ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813) file = sled-agent/src/probe_manager.rs:231 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
6262024-11-09T01:20:35.676ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
6272024-11-09T01:20:35.676ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6282024-11-09T01:20:35.677ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6292024-11-09T01:20:35.677ZINFOSledAgent (ServiceManager): No ledger in /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/omicron-zones.json file = common/src/ledger.rs:188
6302024-11-09T01:20:35.677ZINFOSledAgent (ServiceManager): No ledger in /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/omicron-zones.json file = common/src/ledger.rs:188
6312024-11-09T01:20:35.677ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6322024-11-09T01:20:35.725ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6332024-11-09T01:20:35.725ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6342024-11-09T01:20:35.725ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6352024-11-09T01:20:35.731ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:418
6362024-11-09T01:20:35.731ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/8c24f6fb-cc5e-4758-a216-4357bbb5d813) file = sled-agent/src/nexus.rs:527 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
6372024-11-09T01:20:35.779ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9 file = illumos-utils/src/zone.rs:325
6382024-11-09T01:20:35.783ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2 file = illumos-utils/src/zone.rs:325
6392024-11-09T01:20:35.788ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68 file = illumos-utils/src/zone.rs:325
6402024-11-09T01:20:35.794ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:686
6412024-11-09T01:20:35.795ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:731
6422024-11-09T01:20:35.795ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:734 uptime = 1
6432024-11-09T01:20:35.795ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:440
6442024-11-09T01:20:35.828ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68 file = illumos-utils/src/zone.rs:363
6452024-11-09T01:20:35.833ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9 file = illumos-utils/src/zone.rs:363
6462024-11-09T01:20:35.837ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2 file = illumos-utils/src/zone.rs:363
6472024-11-09T01:20:35.844ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
6482024-11-09T01:20:35.899ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6492024-11-09T01:20:35.899ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6502024-11-09T01:20:35.899ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6512024-11-09T01:20:35.899ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6522024-11-09T01:20:35.899ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6532024-11-09T01:20:35.899ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6542024-11-09T01:20:35.899ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6552024-11-09T01:20:35.899ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6562024-11-09T01:20:35.899ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6572024-11-09T01:20:35.899ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6582024-11-09T01:20:35.899ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6592024-11-09T01:20:35.899ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6602024-11-09T01:20:35.899ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6612024-11-09T01:20:35.899ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6622024-11-09T01:20:35.899ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6632024-11-09T01:20:35.899ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6642024-11-09T01:20:35.899ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6652024-11-09T01:20:35.899ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6662024-11-09T01:20:35.899ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6672024-11-09T01:20:35.899ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6682024-11-09T01:20:35.899ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6692024-11-09T01:20:35.899ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6702024-11-09T01:20:35.899ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6712024-11-09T01:20:36.354ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7844080888539011897 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
6722024-11-09T01:20:36.354ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10775002322017477020 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
6732024-11-09T01:20:36.673ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813) file = sled-agent/src/probe_manager.rs:231 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
6742024-11-09T01:20:37.454ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6752024-11-09T01:20:37.454ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6762024-11-09T01:20:37.455ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68
6772024-11-09T01:20:37.939ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6782024-11-09T01:20:38.421ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6792024-11-09T01:20:38.421ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6802024-11-09T01:20:38.422ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6812024-11-09T01:20:38.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68") failed: Property not found. retry in 49.289975ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68
6822024-11-09T01:20:38.430ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9
6832024-11-09T01:20:38.434ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2
6842024-11-09T01:20:38.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68") failed: Property not found. retry in 74.937888ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68
6852024-11-09T01:20:38.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9") failed: Property not found. retry in 35.231579ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9
6862024-11-09T01:20:38.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2") failed: Property not found. retry in 25.384604ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2
6872024-11-09T01:20:38.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68") failed: Property not found. retry in 207.998447ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68
6882024-11-09T01:20:38.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2") failed: Property not found. retry in 136.939209ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2
6892024-11-09T01:20:38.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9") failed: Property not found. retry in 134.661458ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9
6902024-11-09T01:20:38.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2") failed: Property not found. retry in 241.758819ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2
6912024-11-09T01:20:38.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68") failed: Property not found. retry in 496.524257ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68
6922024-11-09T01:20:38.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9") failed: Property not found. retry in 111.843487ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9
6932024-11-09T01:20:39.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9") failed: Property not found. retry in 399.30032ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9
6942024-11-09T01:20:39.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2") failed: Property not found. retry in 241.34529ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2
6952024-11-09T01:20:39.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2") failed: Property not found. retry in 522.552082ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2
6962024-11-09T01:20:39.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68") failed: Property not found. retry in 912.682866ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68
6972024-11-09T01:20:39.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9") failed: Property not found. retry in 830.237554ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9
6982024-11-09T01:20:39.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2") failed: Property not found. retry in 693.077434ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2
6992024-11-09T01:20:40.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9") failed: Property not found. retry in 586.048284ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9
7002024-11-09T01:20:40.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68") failed: Property not found. retry in 815.327141ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68
7012024-11-09T01:20:40.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2") failed: Property not found. retry in 675.752103ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2
7022024-11-09T01:20:40.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9") failed: Property not found. retry in 1.221388596s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9
7032024-11-09T01:20:41.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68") failed: Property not found. retry in 838.513287ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68
7042024-11-09T01:20:41.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2") failed: Property not found. retry in 1.162374106s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2
7052024-11-09T01:20:41.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68") failed: Property not found. retry in 848.189314ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68
7062024-11-09T01:20:42.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9") failed: Property not found. retry in 1.405272457s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9
7072024-11-09T01:20:42.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2") failed: Property not found. retry in 861.458053ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2
7082024-11-09T01:20:42.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68") failed: Property not found. retry in 744.77244ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68
7092024-11-09T01:20:43.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2") failed: Property not found. retry in 584.194268ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2
7102024-11-09T01:20:43.885ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_30d356ab-a881-4ca3-8f43-203be0381a68
7112024-11-09T01:20:43.885ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_d55caa1f-cc37-4ecb-b8bf-58b9052db1d9
7122024-11-09T01:20:43.885ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2
7132024-11-09T01:20:43.885ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7142024-11-09T01:20:43.885ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7152024-11-09T01:20:43.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8314484 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53778 req_id = cf2a52c8-758c-4259-93ab-a505399f102f response_code = 204 uri = /omicron-zones
7162024-11-09T01:20:43.888ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7172024-11-09T01:20:44.410ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 90.69699ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:675
7182024-11-09T01:20:44.519ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7192024-11-09T01:20:44.567ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7202024-11-09T01:20:44.616ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:691
7212024-11-09T01:20:44.616ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7222024-11-09T01:20:44.649ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7232024-11-09T01:20:44.650ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7242024-11-09T01:20:44.650ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7252024-11-09T01:20:44.678ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: d55caa1f-cc37-4ecb-b8bf-58b9052db1d9 (service), filesystem_pool: Some(ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 30d356ab-a881-4ca3-8f43-203be0381a68 (service), filesystem_pool: Some(ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2 (service), filesystem_pool: Some(ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 62af5e05-a11d-4c37-b456-e04ca52c2a1d (service), filesystem_pool: Some(ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 7fb7a070-4cf4-439b-af08-c73d867e0926, kind: Service { id: 62af5e05-a11d-4c37-b456-e04ca52c2a1d }, name: Name("ntp-62af5e05-a11d-4c37-b456-e04ca52c2a1d"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 81])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
7262024-11-09T01:20:44.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36495
7272024-11-09T01:20:44.679ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d55caa1f-cc37-4ecb-b8bf-58b9052db1d9, dataset_name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7282024-11-09T01:20:44.679ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d55caa1f-cc37-4ecb-b8bf-58b9052db1d9, dataset_name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7292024-11-09T01:20:44.716ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 30d356ab-a881-4ca3-8f43-203be0381a68, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7302024-11-09T01:20:44.717ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 30d356ab-a881-4ca3-8f43-203be0381a68, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7312024-11-09T01:20:44.752ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2, dataset_name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7322024-11-09T01:20:44.752ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2, dataset_name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7332024-11-09T01:20:44.786ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7342024-11-09T01:20:44.786ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/omicron-zones.json file = common/src/ledger.rs:177
7352024-11-09T01:20:44.786ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/omicron-zones.json file = common/src/ledger.rs:177
7362024-11-09T01:20:44.786ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7372024-11-09T01:20:44.797ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7382024-11-09T01:20:44.829ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7392024-11-09T01:20:44.830ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7402024-11-09T01:20:44.830ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7412024-11-09T01:20:44.859ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 215, 81]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7422024-11-09T01:20:44.859ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7432024-11-09T01:20:44.859ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7442024-11-09T01:20:44.859ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7452024-11-09T01:20:44.860ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7462024-11-09T01:20:44.860ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7472024-11-09T01:20:44.883ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d file = illumos-utils/src/zone.rs:325
7482024-11-09T01:20:44.901ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d file = illumos-utils/src/zone.rs:363
7492024-11-09T01:20:45.391ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10140927342222296208 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
7502024-11-09T01:20:45.391ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8384839939087239612 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
7512024-11-09T01:20:45.510ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7522024-11-09T01:20:45.510ZINFOSledAgent (ServiceManager): Booting oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d
7532024-11-09T01:20:45.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d") failed: Property not found. retry in 71.358508ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d
7542024-11-09T01:20:45.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d") failed: Property not found. retry in 94.851055ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d
7552024-11-09T01:20:45.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d") failed: Property not found. retry in 219.374865ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d
7562024-11-09T01:20:46.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d") failed: Property not found. retry in 233.054579ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d
7572024-11-09T01:20:46.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d") failed: Property not found. retry in 1.181744729s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d
7582024-11-09T01:20:46.355ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7844080888539011897 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
7592024-11-09T01:20:46.356ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10775002322017477020 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
7602024-11-09T01:20:47.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d") failed: Property not found. retry in 782.575107ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d
7612024-11-09T01:20:48.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d") failed: Property not found. retry in 1.112241409s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d
7622024-11-09T01:20:49.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d") failed: Property not found. retry in 666.119726ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d
7632024-11-09T01:20:50.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d") failed: Property not found. retry in 1.381569739s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d
7642024-11-09T01:20:51.484ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d
7652024-11-09T01:20:51.484ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7662024-11-09T01:20:51.484ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7672024-11-09T01:20:51.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6806121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36495 req_id = aee28a7e-c78d-422c-a659-29fb3fb258d8 response_code = 204 uri = /omicron-zones
7682024-11-09T01:20:51.487ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:732
7692024-11-09T01:20:51.517ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7702024-11-09T01:20:51.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57759
7712024-11-09T01:20:51.525ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7722024-11-09T01:20:51.525ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 8330 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57759 req_id = 4afcf647-098e-4324-ae47-44b9ea25bcd5 response_code = 500 uri = /timesync
7732024-11-09T01:20:51.527ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7742024-11-09T01:20:51.637ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7752024-11-09T01:20:51.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40792
7762024-11-09T01:20:53.534ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11548005602334504145 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
7772024-11-09T01:20:53.585ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12152994875910346324 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
7782024-11-09T01:20:53.887ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9578433900653797638 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
7792024-11-09T01:20:55.392ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10140927342222296208 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
7802024-11-09T01:20:55.393ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8384839939087239612 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
7812024-11-09T01:20:55.645ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7822024-11-09T01:20:55.646ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 4008717 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40792 req_id = 44c1919b-7de3-4812-a13f-83dd6f936cb2 response_code = 500 uri = /timesync
7832024-11-09T01:20:55.648ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7842024-11-09T01:20:55.741ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7852024-11-09T01:20:55.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34646
7862024-11-09T01:20:55.750ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7872024-11-09T01:20:55.750ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 8270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34646 req_id = d516b560-ffdf-40ba-ac8a-78eec1b3e674 response_code = 500 uri = /timesync
7882024-11-09T01:20:55.752ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7892024-11-09T01:20:55.914ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7902024-11-09T01:20:55.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37024
7912024-11-09T01:20:56.358ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7844080888539011897 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
7922024-11-09T01:20:56.358ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10775002322017477020 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
7932024-11-09T01:21:00.501ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_62af5e05-a11d-4c37-b456-e04ca52c2a1d': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7942024-11-09T01:21:00.501ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 4009761 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37024 req_id = 504466e5-193a-4da0-b8a7-7af50d8a6baa response_code = 500 uri = /timesync
7952024-11-09T01:21:00.503ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7962024-11-09T01:21:00.724ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7972024-11-09T01:21:00.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58389
7982024-11-09T01:21:00.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8866 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58389 req_id = d25ce5c2-5971-4283-9bf1-4430406e42c9 response_code = 200 uri = /timesync
7992024-11-09T01:21:00.735ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731115258.265023, correction: -0.033443447 } file = sled-agent/src/rack_setup/service.rs:740
8002024-11-09T01:21:00.736ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8012024-11-09T01:21:01.037ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8022024-11-09T01:21:01.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52620
8032024-11-09T01:21:01.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7493 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52620 req_id = 0d525b50-a311-40ee-9d35-0ce98aee9b9e response_code = 200 uri = /timesync
8042024-11-09T01:21:01.046ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731115258.265023, correction: -0.039639298 } file = sled-agent/src/rack_setup/service.rs:740
8052024-11-09T01:21:01.046ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8062024-11-09T01:21:01.423ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8072024-11-09T01:21:01.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51293
8082024-11-09T01:21:01.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9048 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51293 req_id = a2f460bd-664d-48a5-834a-0bb306d0fd9d response_code = 200 uri = /timesync
8092024-11-09T01:21:01.435ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731115258.265023, correction: -0.038585268 } file = sled-agent/src/rack_setup/service.rs:740
8102024-11-09T01:21:01.435ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8112024-11-09T01:21:01.621ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8122024-11-09T01:21:01.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33179
8132024-11-09T01:21:01.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8740 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33179 req_id = c76e65b6-999d-49c7-ad26-7c9742f9974f response_code = 200 uri = /timesync
8142024-11-09T01:21:01.631ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731115258.265023, correction: -0.038048908 } file = sled-agent/src/rack_setup/service.rs:740
8152024-11-09T01:21:01.631ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8162024-11-09T01:21:01.882ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 331.628263ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
8172024-11-09T01:21:01.945ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8182024-11-09T01:21:01.945ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49400
8192024-11-09T01:21:01.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7581 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49400 req_id = 17ff4c02-2c09-4886-8b1f-fa96e5ed0f9e response_code = 200 uri = /timesync
8202024-11-09T01:21:01.955ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731115258.265023, correction: -0.040875535 } file = sled-agent/src/rack_setup/service.rs:740
8212024-11-09T01:21:01.955ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8222024-11-09T01:21:02.060ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9018077952382910874 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
8232024-11-09T01:21:02.060ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1930496665283843972 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
8242024-11-09T01:21:02.275ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8252024-11-09T01:21:02.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47582
8262024-11-09T01:21:02.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8332 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47582 req_id = 385deb00-1a0f-4463-a780-c6db6219990b response_code = 200 uri = /timesync
8272024-11-09T01:21:02.286ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731115258.265023, correction: -0.03997672 } file = sled-agent/src/rack_setup/service.rs:740
8282024-11-09T01:21:02.286ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8292024-11-09T01:21:02.847ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8302024-11-09T01:21:02.847ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53417
8312024-11-09T01:21:02.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7655 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53417 req_id = 6bf42c93-b9ee-40b9-9115-a6ba7b6d78b3 response_code = 200 uri = /timesync
8322024-11-09T01:21:02.856ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731115258.265023, correction: -0.038425632 } file = sled-agent/src/rack_setup/service.rs:740
8332024-11-09T01:21:02.856ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8342024-11-09T01:21:03.734ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8352024-11-09T01:21:03.734ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45462
8362024-11-09T01:21:03.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45462 req_id = 3ad5a757-4ab3-4ce0-b47e-092b57a9d25c response_code = 200 uri = /timesync
8372024-11-09T01:21:03.744ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731115258.265023, correction: -0.030451838 } file = sled-agent/src/rack_setup/service.rs:740
8382024-11-09T01:21:03.744ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8392024-11-09T01:21:04.103ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11548005602334504145 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
8402024-11-09T01:21:04.153ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12152994875910346324 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
8412024-11-09T01:21:04.230ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8422024-11-09T01:21:04.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60848
8432024-11-09T01:21:04.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 19518 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60848 req_id = 4c2d7c8d-46c9-4ea1-a33c-e0edafeeaea6 response_code = 200 uri = /timesync
8442024-11-09T01:21:04.252ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1255151918, ip_addr: 74.208.25.46, stratum: 4, ref_time: 1731115263.1331, correction: -0.024264643 } file = sled-agent/src/rack_setup/service.rs:740
8452024-11-09T01:21:04.252ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1423
8462024-11-09T01:21:04.281ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: d55caa1f-cc37-4ecb-b8bf-58b9052db1d9 (service), filesystem_pool: Some(ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 30d356ab-a881-4ca3-8f43-203be0381a68 (service), filesystem_pool: Some(ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2 (service), filesystem_pool: Some(ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 62af5e05-a11d-4c37-b456-e04ca52c2a1d (service), filesystem_pool: Some(ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 7fb7a070-4cf4-439b-af08-c73d867e0926, kind: Service { id: 62af5e05-a11d-4c37-b456-e04ca52c2a1d }, name: Name("ntp-62af5e05-a11d-4c37-b456-e04ca52c2a1d"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 81])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: e560f12b-d6ab-4f2d-8a07-855c3de6295c (service), filesystem_pool: Some(ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External } } } }, OmicronZoneConfig { id: ae6c3d6a-c339-43ef-98c6-59975f230e3c (service), filesystem_pool: Some(ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External } } } }, OmicronZoneConfig { id: abcf3801-fdc6-4fa6-b2c5-7384303bb492 (service), filesystem_pool: Some(ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External } } } }, OmicronZoneConfig { id: 528e0d1c-1d8f-4486-9342-ffccb5c095db (service), filesystem_pool: Some(ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External } } } }, OmicronZoneConfig { id: 46b5cc55-1951-48ff-a368-917c171bf1e5 (service), filesystem_pool: Some(ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
8472024-11-09T01:21:04.281ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64706
8482024-11-09T01:21:04.282ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d55caa1f-cc37-4ecb-b8bf-58b9052db1d9, dataset_name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8492024-11-09T01:21:04.282ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d55caa1f-cc37-4ecb-b8bf-58b9052db1d9, dataset_name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8502024-11-09T01:21:04.316ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 30d356ab-a881-4ca3-8f43-203be0381a68, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8512024-11-09T01:21:04.316ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 30d356ab-a881-4ca3-8f43-203be0381a68, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8522024-11-09T01:21:04.347ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2, dataset_name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8532024-11-09T01:21:04.347ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2, dataset_name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8542024-11-09T01:21:04.376ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e560f12b-d6ab-4f2d-8a07-855c3de6295c, dataset_name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8552024-11-09T01:21:04.377ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e560f12b-d6ab-4f2d-8a07-855c3de6295c, dataset_name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8562024-11-09T01:21:04.410ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ae6c3d6a-c339-43ef-98c6-59975f230e3c, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8572024-11-09T01:21:04.410ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ae6c3d6a-c339-43ef-98c6-59975f230e3c, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8582024-11-09T01:21:04.441ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: abcf3801-fdc6-4fa6-b2c5-7384303bb492, dataset_name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8592024-11-09T01:21:04.442ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: abcf3801-fdc6-4fa6-b2c5-7384303bb492, dataset_name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8602024-11-09T01:21:04.474ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 528e0d1c-1d8f-4486-9342-ffccb5c095db, dataset_name: DatasetName { pool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8612024-11-09T01:21:04.474ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 528e0d1c-1d8f-4486-9342-ffccb5c095db, dataset_name: DatasetName { pool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8622024-11-09T01:21:04.505ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 46b5cc55-1951-48ff-a368-917c171bf1e5, dataset_name: DatasetName { pool_name: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8632024-11-09T01:21:04.505ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 46b5cc55-1951-48ff-a368-917c171bf1e5, dataset_name: DatasetName { pool_name: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }, kind: Cockroach }, responder: ... }
8642024-11-09T01:21:04.537ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8652024-11-09T01:21:04.537ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/omicron-zones.json file = common/src/ledger.rs:177
8662024-11-09T01:21:04.537ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/omicron-zones.json file = common/src/ledger.rs:177
8672024-11-09T01:21:04.537ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8682024-11-09T01:21:04.620ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8692024-11-09T01:21:04.620ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8702024-11-09T01:21:04.620ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8712024-11-09T01:21:04.620ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8722024-11-09T01:21:04.620ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8732024-11-09T01:21:04.711ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db file = illumos-utils/src/zone.rs:325
8742024-11-09T01:21:04.715ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c file = illumos-utils/src/zone.rs:325
8752024-11-09T01:21:04.719ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c file = illumos-utils/src/zone.rs:325
8762024-11-09T01:21:04.723ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492 file = illumos-utils/src/zone.rs:325
8772024-11-09T01:21:04.728ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5 file = illumos-utils/src/zone.rs:325
8782024-11-09T01:21:04.732ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db file = illumos-utils/src/zone.rs:363
8792024-11-09T01:21:04.737ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c file = illumos-utils/src/zone.rs:363
8802024-11-09T01:21:04.742ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c file = illumos-utils/src/zone.rs:363
8812024-11-09T01:21:04.746ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492 file = illumos-utils/src/zone.rs:363
8822024-11-09T01:21:04.751ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5 file = illumos-utils/src/zone.rs:363
8832024-11-09T01:21:05.998ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53945
8842024-11-09T01:21:05.998ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53945 req_id = 7e08eb1b-aee7-4c36-addb-1b5f20572347 response_code = 200 uri = /baseboard
8852024-11-09T01:21:07.629ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ae6c3d6a-c339-43ef-98c6-59975f230e3c'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8862024-11-09T01:21:07.629ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c
8872024-11-09T01:21:07.703ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='528e0d1c-1d8f-4486-9342-ffccb5c095db'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8882024-11-09T01:21:07.703ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db
8892024-11-09T01:21:07.709ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='e560f12b-d6ab-4f2d-8a07-855c3de6295c'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8902024-11-09T01:21:07.709ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='46b5cc55-1951-48ff-a368-917c171bf1e5'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8912024-11-09T01:21:07.709ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c
8922024-11-09T01:21:07.714ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5
8932024-11-09T01:21:07.753ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='abcf3801-fdc6-4fa6-b2c5-7384303bb492'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8942024-11-09T01:21:07.754ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492
8952024-11-09T01:21:07.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c") failed: Property not found. retry in 41.703139ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c
8962024-11-09T01:21:07.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c") failed: Property not found. retry in 141.590863ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c
8972024-11-09T01:21:07.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db") failed: Property not found. retry in 43.211491ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db
8982024-11-09T01:21:07.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c") failed: Property not found. retry in 33.239212ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c
8992024-11-09T01:21:07.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db") failed: Property not found. retry in 133.425949ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db
9002024-11-09T01:21:07.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5") failed: Property not found. retry in 63.551403ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5
9012024-11-09T01:21:08.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c") failed: Property not found. retry in 100.028506ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c
9022024-11-09T01:21:08.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c") failed: Property not found. retry in 119.419816ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c
9032024-11-09T01:21:08.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db") failed: Property not found. retry in 112.100186ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db
9042024-11-09T01:21:08.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c") failed: Property not found. retry in 203.979145ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c
9052024-11-09T01:21:08.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c") failed: Property not found. retry in 377.435359ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c
9062024-11-09T01:21:08.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492") failed: Property not found. retry in 40.431176ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492
9072024-11-09T01:21:08.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5") failed: Property not found. retry in 93.084071ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5
9082024-11-09T01:21:09.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db") failed: Property not found. retry in 527.910205ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db
9092024-11-09T01:21:09.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c") failed: Property not found. retry in 406.748943ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c
9102024-11-09T01:21:09.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c") failed: Property not found. retry in 696.832247ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c
9112024-11-09T01:21:10.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492") failed: Property not found. retry in 68.97638ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492
9122024-11-09T01:21:10.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5") failed: Property not found. retry in 271.273875ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5
9132024-11-09T01:21:10.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db") failed: Property not found. retry in 757.262951ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db
9142024-11-09T01:21:10.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c") failed: Property not found. retry in 882.657809ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c
9152024-11-09T01:21:10.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c") failed: Property not found. retry in 663.79755ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c
9162024-11-09T01:21:10.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492") failed: Property not found. retry in 278.896394ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492
9172024-11-09T01:21:10.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5") failed: Property not found. retry in 395.110519ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5
9182024-11-09T01:21:10.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492") failed: Property not found. retry in 521.846618ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492
9192024-11-09T01:21:10.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5") failed: Property not found. retry in 1.185873924s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5
9202024-11-09T01:21:11.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c") failed: Property not found. retry in 1.24473041s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c
9212024-11-09T01:21:11.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db") failed: Property not found. retry in 1.069665787s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db
9222024-11-09T01:21:11.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c") failed: Property not found. retry in 752.485585ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c
9232024-11-09T01:21:11.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492") failed: Property not found. retry in 1.171722218s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492
9242024-11-09T01:21:12.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c") failed: Property not found. retry in 962.741065ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c
9252024-11-09T01:21:12.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5") failed: Property not found. retry in 1.178736884s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5
9262024-11-09T01:21:12.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db") failed: Property not found. retry in 861.727719ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db
9272024-11-09T01:21:12.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c") failed: Property not found. retry in 1.176761242s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c
9282024-11-09T01:21:12.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492") failed: Property not found. retry in 1.189405378s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492
9292024-11-09T01:21:13.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c") failed: Property not found. retry in 1.129365256s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c
9302024-11-09T01:21:13.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db") failed: Property not found. retry in 939.865342ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db
9312024-11-09T01:21:13.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5") failed: Property not found. retry in 917.035614ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5
9322024-11-09T01:21:13.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c") failed: Property not found. retry in 1.397645698s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c
9332024-11-09T01:21:13.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492") failed: Property not found. retry in 1.121335947s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492
9342024-11-09T01:21:14.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db") failed: Property not found. retry in 568.501867ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db
9352024-11-09T01:21:14.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c") failed: Property not found. retry in 730.903608ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c
9362024-11-09T01:21:14.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5") failed: Property not found. retry in 1.027504073s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5
9372024-11-09T01:21:14.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db") failed: Property not found. retry in 1.014518505s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db
9382024-11-09T01:21:14.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492") failed: Property not found. retry in 1.200853947s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492
9392024-11-09T01:21:14.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c") failed: Property not found. retry in 508.814026ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c
9402024-11-09T01:21:14.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c") failed: Property not found. retry in 1.298999737s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c
9412024-11-09T01:21:15.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5") failed: Property not found. retry in 1.001424848s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5
9422024-11-09T01:21:15.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c") failed: Property not found. retry in 1.320889048s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c
9432024-11-09T01:21:15.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db") failed: Property not found. retry in 547.464238ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db
9442024-11-09T01:21:16.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492") failed: Property not found. retry in 1.214982558s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492
9452024-11-09T01:21:16.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db") failed: Property not found. retry in 658.902235ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db
9462024-11-09T01:21:16.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c") failed: Property not found. retry in 685.988412ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c
9472024-11-09T01:21:16.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5") failed: Property not found. retry in 845.219233ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5
9482024-11-09T01:21:16.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c") failed: Property not found. retry in 1.29875383s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c
9492024-11-09T01:21:16.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db") failed: Property not found. retry in 695.364884ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db
9502024-11-09T01:21:16.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c") failed: Property not found. retry in 807.952259ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c
9512024-11-09T01:21:17.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5") failed: Property not found. retry in 631.716952ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5
9522024-11-09T01:21:17.223ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 255.114464ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
9532024-11-09T01:21:17.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492") failed: Property not found. retry in 1.269631798s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492
9542024-11-09T01:21:17.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db") failed: Property not found. retry in 786.710306ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db
9552024-11-09T01:21:17.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c") failed: Property not found. retry in 1.310851266s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c
9562024-11-09T01:21:17.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5") failed: Property not found. retry in 1.089750423s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5
9572024-11-09T01:21:18.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c") failed: Property not found. retry in 1.226602359s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c
9582024-11-09T01:21:18.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db") failed: Property not found. retry in 1.255545016s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db
9592024-11-09T01:21:18.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492") failed: Property not found. retry in 1.418943452s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492
9602024-11-09T01:21:18.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5") failed: Property not found. retry in 1.097886998s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5
9612024-11-09T01:21:19.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c") failed: Property not found. retry in 790.009411ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c
9622024-11-09T01:21:19.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c") failed: Property not found. retry in 988.601358ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c
9632024-11-09T01:21:19.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db") failed: Property not found. retry in 1.355771324s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db
9642024-11-09T01:21:19.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492") failed: Property not found. retry in 663.211222ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492
9652024-11-09T01:21:20.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5") failed: Property not found. retry in 921.407578ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5
9662024-11-09T01:21:20.983ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_528e0d1c-1d8f-4486-9342-ffccb5c095db
9672024-11-09T01:21:20.983ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_e560f12b-d6ab-4f2d-8a07-855c3de6295c
9682024-11-09T01:21:20.983ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_ae6c3d6a-c339-43ef-98c6-59975f230e3c
9692024-11-09T01:21:20.983ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_abcf3801-fdc6-4fa6-b2c5-7384303bb492
9702024-11-09T01:21:20.983ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5
9712024-11-09T01:21:20.983ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9722024-11-09T01:21:20.984ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9732024-11-09T01:21:20.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 16720571 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:64706 req_id = 43ddb8a7-cc43-4fe2-a1d3-cea2709f6611 response_code = 204 uri = /omicron-zones
9742024-11-09T01:21:21.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39345
9752024-11-09T01:21:21.047ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 29551 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39345 req_id = 2baa9001-0aa5-479e-945e-0ff1fae0e7a7 response_code = 500 uri = /cockroachdb
9762024-11-09T01:21:21.047ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2baa9001-0aa5-479e-945e-0ff1fae0e7a7", "content-length": "124", "date": "Sat, 09 Nov 2024 01:21:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2baa9001-0aa5-479e-945e-0ff1fae0e7a7" } file = sled-agent/src/rack_setup/service.rs:1152 retry_after = 146.986669ms
9772024-11-09T01:21:21.221ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 26071 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39345 req_id = 71f8c948-3306-4afc-954b-148e81237106 response_code = 500 uri = /cockroachdb
9782024-11-09T01:21:21.221ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "71f8c948-3306-4afc-954b-148e81237106", "content-length": "124", "date": "Sat, 09 Nov 2024 01:21:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "71f8c948-3306-4afc-954b-148e81237106" } file = sled-agent/src/rack_setup/service.rs:1152 retry_after = 178.028803ms
9792024-11-09T01:21:21.427ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 27295 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39345 req_id = 3e9c5a59-45bf-42aa-81c2-d9355882c900 response_code = 500 uri = /cockroachdb
9802024-11-09T01:21:21.428ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3e9c5a59-45bf-42aa-81c2-d9355882c900", "content-length": "124", "date": "Sat, 09 Nov 2024 01:21:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3e9c5a59-45bf-42aa-81c2-d9355882c900" } file = sled-agent/src/rack_setup/service.rs:1152 retry_after = 109.675701ms
9812024-11-09T01:21:21.564ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 25836 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39345 req_id = a6eba7b9-5c1c-4f38-9032-7970d18836dd response_code = 500 uri = /cockroachdb
9822024-11-09T01:21:21.564ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a6eba7b9-5c1c-4f38-9032-7970d18836dd", "content-length": "124", "date": "Sat, 09 Nov 2024 01:21:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a6eba7b9-5c1c-4f38-9032-7970d18836dd" } file = sled-agent/src/rack_setup/service.rs:1152 retry_after = 128.77378ms
9832024-11-09T01:21:21.720ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 26142 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39345 req_id = 49179a1a-5d63-4911-99f4-5a14a74eaa58 response_code = 500 uri = /cockroachdb
9842024-11-09T01:21:21.720ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "49179a1a-5d63-4911-99f4-5a14a74eaa58", "content-length": "124", "date": "Sat, 09 Nov 2024 01:21:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "49179a1a-5d63-4911-99f4-5a14a74eaa58" } file = sled-agent/src/rack_setup/service.rs:1152 retry_after = 291.445059ms
9852024-11-09T01:21:22.039ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 26133 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39345 req_id = 01e13514-6099-4787-890d-5ac40a70e0c4 response_code = 500 uri = /cockroachdb
9862024-11-09T01:21:22.039ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "01e13514-6099-4787-890d-5ac40a70e0c4", "content-length": "124", "date": "Sat, 09 Nov 2024 01:21:22 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "01e13514-6099-4787-890d-5ac40a70e0c4" } file = sled-agent/src/rack_setup/service.rs:1152 retry_after = 359.476887ms
9872024-11-09T01:21:22.423ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 24996 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39345 req_id = ba734412-5eb2-4b78-89f1-dd57c50c72f1 response_code = 500 uri = /cockroachdb
9882024-11-09T01:21:22.424ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ba734412-5eb2-4b78-89f1-dd57c50c72f1", "content-length": "124", "date": "Sat, 09 Nov 2024 01:21:22 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ba734412-5eb2-4b78-89f1-dd57c50c72f1" } file = sled-agent/src/rack_setup/service.rs:1152 retry_after = 243.076935ms
9892024-11-09T01:21:22.692ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 24602 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39345 req_id = 79436d05-0d65-44e1-9702-b5e80a05a2a9 response_code = 500 uri = /cockroachdb
9902024-11-09T01:21:22.692ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "79436d05-0d65-44e1-9702-b5e80a05a2a9", "content-length": "124", "date": "Sat, 09 Nov 2024 01:21:22 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "79436d05-0d65-44e1-9702-b5e80a05a2a9" } file = sled-agent/src/rack_setup/service.rs:1152 retry_after = 322.260646ms
9912024-11-09T01:21:23.055ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 38976 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39345 req_id = 726be990-9638-4e08-bb80-71d04053e7e7 response_code = 500 uri = /cockroachdb
9922024-11-09T01:21:23.055ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "726be990-9638-4e08-bb80-71d04053e7e7", "content-length": "124", "date": "Sat, 09 Nov 2024 01:21:23 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "726be990-9638-4e08-bb80-71d04053e7e7" } file = sled-agent/src/rack_setup/service.rs:1152 retry_after = 601.697648ms
9932024-11-09T01:21:23.685ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 27359 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39345 req_id = 9c19abf2-1432-4adb-b3e6-4e9c159d6560 response_code = 500 uri = /cockroachdb
9942024-11-09T01:21:23.685ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9c19abf2-1432-4adb-b3e6-4e9c159d6560", "content-length": "124", "date": "Sat, 09 Nov 2024 01:21:23 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9c19abf2-1432-4adb-b3e6-4e9c159d6560" } file = sled-agent/src/rack_setup/service.rs:1152 retry_after = 721.099014ms
9952024-11-09T01:21:24.434ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_46b5cc55-1951-48ff-a368-917c171bf1e5 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 27977 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39345 req_id = 0a965773-9917-4394-af46-f76aaf64e802 response_code = 500 uri = /cockroachdb
9962024-11-09T01:21:24.434ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0a965773-9917-4394-af46-f76aaf64e802", "content-length": "124", "date": "Sat, 09 Nov 2024 01:21:24 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0a965773-9917-4394-af46-f76aaf64e802" } file = sled-agent/src/rack_setup/service.rs:1152 retry_after = 880.329897ms
9972024-11-09T01:21:25.348ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3743
9982024-11-09T01:21:42.431ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
9992024-11-09T01:21:50.031ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
10002024-11-09T01:21:50.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 24715724 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39345 req_id = 300d1469-4cfa-46c0-be00-e08162471c33 response_code = 204 uri = /cockroachdb
10012024-11-09T01:21:50.034ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39135
10022024-11-09T01:21:50.035ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 688 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39135 req_id = f51fa205-028c-4e22-bf58-02d61fdf8664 response_code = 200 uri = /baseboard
10032024-11-09T01:21:50.042ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.250411337s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
10042024-11-09T01:21:50.078ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: d55caa1f-cc37-4ecb-b8bf-58b9052db1d9 (service), filesystem_pool: Some(ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 30d356ab-a881-4ca3-8f43-203be0381a68 (service), filesystem_pool: Some(ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2 (service), filesystem_pool: Some(ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 62af5e05-a11d-4c37-b456-e04ca52c2a1d (service), filesystem_pool: Some(ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 7fb7a070-4cf4-439b-af08-c73d867e0926, kind: Service { id: 62af5e05-a11d-4c37-b456-e04ca52c2a1d }, name: Name("ntp-62af5e05-a11d-4c37-b456-e04ca52c2a1d"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 81])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: e560f12b-d6ab-4f2d-8a07-855c3de6295c (service), filesystem_pool: Some(ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External } } } }, OmicronZoneConfig { id: ae6c3d6a-c339-43ef-98c6-59975f230e3c (service), filesystem_pool: Some(ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External } } } }, OmicronZoneConfig { id: abcf3801-fdc6-4fa6-b2c5-7384303bb492 (service), filesystem_pool: Some(ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External } } } }, OmicronZoneConfig { id: 528e0d1c-1d8f-4486-9342-ffccb5c095db (service), filesystem_pool: Some(ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External } } } }, OmicronZoneConfig { id: 46b5cc55-1951-48ff-a368-917c171bf1e5 (service), filesystem_pool: Some(ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External } } } }, OmicronZoneConfig { id: 34219892-cef8-4169-a366-ce17844120f6 (service), filesystem_pool: Some(ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 49d235c5-d54d-4258-a645-9d181875557a, kind: Service { id: 34219892-cef8-4169-a366-ce17844120f6 }, name: Name("external-dns-34219892-cef8-4169-a366-ce17844120f6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 530f76d0-bec9-4ae0-beb0-d217f68ae05a (service), filesystem_pool: Some(ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: ce088bfb-77e0-4498-b680-d4fab72b0123, kind: Service { id: 530f76d0-bec9-4ae0-beb0-d217f68ae05a }, name: Name("external-dns-530f76d0-bec9-4ae0-beb0-d217f68ae05a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: d59d4e08-d131-4d11-8244-662923dd9357 (service), filesystem_pool: Some(ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: b1ef6e1e-4501-48bd-9de3-1d5889b6ea55, kind: Service { id: d59d4e08-d131-4d11-8244-662923dd9357 }, name: Name("nexus-d59d4e08-d131-4d11-8244-662923dd9357"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 166])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 02562f58-d954-43f9-93a1-2ae8426ccbe9 (service), filesystem_pool: Some(ZpoolName { id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 9fa251a1-2d97-4513-b670-a39f36efe9c9, kind: Service { id: 02562f58-d954-43f9-93a1-2ae8426ccbe9 }, name: Name("nexus-02562f58-d954-43f9-93a1-2ae8426ccbe9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 86b379c9-5608-41ec-a3b2-837d116869db (service), filesystem_pool: Some(ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 314cfeab-323e-4445-9502-7e16efd0a788, kind: Service { id: 86b379c9-5608-41ec-a3b2-837d116869db }, name: Name("nexus-86b379c9-5608-41ec-a3b2-837d116869db"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: c1f5f1ac-115a-4364-9c55-c9fb1352920b (service), filesystem_pool: Some(ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 4b8e17aa-0aac-4010-9929-5bd5c83a0e4b (service), filesystem_pool: Some(ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External } } } }, OmicronZoneConfig { id: 01a68c16-a577-4363-91a9-597a81dd9194 (service), filesystem_pool: Some(ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7 (service), filesystem_pool: Some(ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 77d141e8-e3c4-452a-a940-c2c505401265 (service), filesystem_pool: Some(ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 827aea44-5b0b-48cf-b23f-23d089e8e9ee (service), filesystem_pool: Some(ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External } } } }, OmicronZoneConfig { id: b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0 (service), filesystem_pool: Some(ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External } } } }, OmicronZoneConfig { id: a2593661-c86b-455e-a9f7-a4c52fc34f36 (service), filesystem_pool: Some(ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External } } } }, OmicronZoneConfig { id: b135bc9d-2a1a-47be-8182-0ff375cf359e (service), filesystem_pool: Some(ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External } } } }, OmicronZoneConfig { id: f53ba5be-5d81-4c31-8175-402f5b6831e1 (service), filesystem_pool: Some(ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External } } } }, OmicronZoneConfig { id: 58a786ea-0927-458c-8915-fb9e014e3ecf (service), filesystem_pool: Some(ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External } } } }, OmicronZoneConfig { id: 83d3dd5d-dcb7-4a28-8b95-23a6786f7940 (service), filesystem_pool: Some(ZpoolName { id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool), kind: External } } } }, OmicronZoneConfig { id: a383ef2b-7c01-4073-9df0-a4815663cea5 (service), filesystem_pool: Some(ZpoolName { id: 429a71c0-de37-4c29-9517-d34e0fdea40d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 429a71c0-de37-4c29-9517-d34e0fdea40d (zpool), kind: External } } } }, OmicronZoneConfig { id: 0d65eac1-48fd-4fc8-a01f-2a39a8a6e371 (service), filesystem_pool: Some(ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
10052024-11-09T01:21:50.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54592
10062024-11-09T01:21:50.079ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d55caa1f-cc37-4ecb-b8bf-58b9052db1d9, dataset_name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10072024-11-09T01:21:50.079ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d55caa1f-cc37-4ecb-b8bf-58b9052db1d9, dataset_name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10082024-11-09T01:21:50.140ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 30d356ab-a881-4ca3-8f43-203be0381a68, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10092024-11-09T01:21:50.140ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 30d356ab-a881-4ca3-8f43-203be0381a68, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10102024-11-09T01:21:50.236ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2, dataset_name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10112024-11-09T01:21:50.237ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2, dataset_name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10122024-11-09T01:21:50.363ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e560f12b-d6ab-4f2d-8a07-855c3de6295c, dataset_name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10132024-11-09T01:21:50.363ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e560f12b-d6ab-4f2d-8a07-855c3de6295c, dataset_name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10142024-11-09T01:21:50.414ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ae6c3d6a-c339-43ef-98c6-59975f230e3c, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10152024-11-09T01:21:50.414ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ae6c3d6a-c339-43ef-98c6-59975f230e3c, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10162024-11-09T01:21:50.464ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: abcf3801-fdc6-4fa6-b2c5-7384303bb492, dataset_name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10172024-11-09T01:21:50.464ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: abcf3801-fdc6-4fa6-b2c5-7384303bb492, dataset_name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10182024-11-09T01:21:50.519ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 528e0d1c-1d8f-4486-9342-ffccb5c095db, dataset_name: DatasetName { pool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10192024-11-09T01:21:50.519ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 528e0d1c-1d8f-4486-9342-ffccb5c095db, dataset_name: DatasetName { pool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10202024-11-09T01:21:50.572ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 46b5cc55-1951-48ff-a368-917c171bf1e5, dataset_name: DatasetName { pool_name: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10212024-11-09T01:21:50.572ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 46b5cc55-1951-48ff-a368-917c171bf1e5, dataset_name: DatasetName { pool_name: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }, kind: Cockroach }, responder: ... }
10222024-11-09T01:21:50.616ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 34219892-cef8-4169-a366-ce17844120f6, dataset_name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10232024-11-09T01:21:50.616ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 34219892-cef8-4169-a366-ce17844120f6, dataset_name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10242024-11-09T01:21:50.664ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 530f76d0-bec9-4ae0-beb0-d217f68ae05a, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10252024-11-09T01:21:50.664ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 530f76d0-bec9-4ae0-beb0-d217f68ae05a, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10262024-11-09T01:21:50.715ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4b8e17aa-0aac-4010-9929-5bd5c83a0e4b, dataset_name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
10272024-11-09T01:21:50.715ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 4b8e17aa-0aac-4010-9929-5bd5c83a0e4b, dataset_name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10282024-11-09T01:21:50.762ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 827aea44-5b0b-48cf-b23f-23d089e8e9ee, dataset_name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10292024-11-09T01:21:50.762ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 827aea44-5b0b-48cf-b23f-23d089e8e9ee, dataset_name: DatasetName { pool_name: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, kind: Crucible }, responder: ... }
10302024-11-09T01:21:50.803ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10312024-11-09T01:21:50.803ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, kind: Crucible }, responder: ... }
10322024-11-09T01:21:50.850ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a2593661-c86b-455e-a9f7-a4c52fc34f36, dataset_name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10332024-11-09T01:21:50.850ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a2593661-c86b-455e-a9f7-a4c52fc34f36, dataset_name: DatasetName { pool_name: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, kind: Crucible }, responder: ... }
10342024-11-09T01:21:50.897ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b135bc9d-2a1a-47be-8182-0ff375cf359e, dataset_name: DatasetName { pool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10352024-11-09T01:21:50.897ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b135bc9d-2a1a-47be-8182-0ff375cf359e, dataset_name: DatasetName { pool_name: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, kind: Crucible }, responder: ... }
10362024-11-09T01:21:50.951ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f53ba5be-5d81-4c31-8175-402f5b6831e1, dataset_name: DatasetName { pool_name: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10372024-11-09T01:21:50.951ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f53ba5be-5d81-4c31-8175-402f5b6831e1, dataset_name: DatasetName { pool_name: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }, kind: Crucible }, responder: ... }
10382024-11-09T01:21:50.995ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 58a786ea-0927-458c-8915-fb9e014e3ecf, dataset_name: DatasetName { pool_name: ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10392024-11-09T01:21:50.995ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 58a786ea-0927-458c-8915-fb9e014e3ecf, dataset_name: DatasetName { pool_name: ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External }, kind: Crucible }, responder: ... }
10402024-11-09T01:21:51.056ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 83d3dd5d-dcb7-4a28-8b95-23a6786f7940, dataset_name: DatasetName { pool_name: ZpoolName { id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10412024-11-09T01:21:51.056ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 83d3dd5d-dcb7-4a28-8b95-23a6786f7940, dataset_name: DatasetName { pool_name: ZpoolName { id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool), kind: External }, kind: Crucible }, responder: ... }
10422024-11-09T01:21:51.113ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a383ef2b-7c01-4073-9df0-a4815663cea5, dataset_name: DatasetName { pool_name: ZpoolName { id: 429a71c0-de37-4c29-9517-d34e0fdea40d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10432024-11-09T01:21:51.113ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a383ef2b-7c01-4073-9df0-a4815663cea5, dataset_name: DatasetName { pool_name: ZpoolName { id: 429a71c0-de37-4c29-9517-d34e0fdea40d (zpool), kind: External }, kind: Crucible }, responder: ... }
10442024-11-09T01:21:51.169ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0d65eac1-48fd-4fc8-a01f-2a39a8a6e371, dataset_name: DatasetName { pool_name: ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10452024-11-09T01:21:51.169ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0d65eac1-48fd-4fc8-a01f-2a39a8a6e371, dataset_name: DatasetName { pool_name: ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External }, kind: Crucible }, responder: ... }
10462024-11-09T01:21:51.223ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10472024-11-09T01:21:51.223ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/omicron-zones.json file = common/src/ledger.rs:177
10482024-11-09T01:21:51.223ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/omicron-zones.json file = common/src/ledger.rs:177
10492024-11-09T01:21:51.223ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10502024-11-09T01:21:51.371ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10512024-11-09T01:21:51.371ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10522024-11-09T01:21:51.371ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10532024-11-09T01:21:51.371ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10542024-11-09T01:21:51.371ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10552024-11-09T01:21:51.383ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10562024-11-09T01:21:51.407ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10572024-11-09T01:21:51.408ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10582024-11-09T01:21:51.408ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10592024-11-09T01:21:51.409ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10602024-11-09T01:21:51.421ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10612024-11-09T01:21:51.617ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10622024-11-09T01:21:51.617ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10632024-11-09T01:21:51.617ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371 file = illumos-utils/src/zone.rs:325
10642024-11-09T01:21:51.617ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10652024-11-09T01:21:51.617ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10662024-11-09T01:21:51.617ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10672024-11-09T01:21:51.617ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10682024-11-09T01:21:51.617ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10692024-11-09T01:21:51.617ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10702024-11-09T01:21:51.621ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf file = illumos-utils/src/zone.rs:325
10712024-11-09T01:21:51.626ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265 file = illumos-utils/src/zone.rs:325
10722024-11-09T01:21:51.631ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940 file = illumos-utils/src/zone.rs:325
10732024-11-09T01:21:51.636ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194 file = illumos-utils/src/zone.rs:325
10742024-11-09T01:21:51.642ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1 file = illumos-utils/src/zone.rs:325
10752024-11-09T01:21:51.647ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee file = illumos-utils/src/zone.rs:325
10762024-11-09T01:21:51.789ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371 file = illumos-utils/src/zone.rs:363
10772024-11-09T01:21:51.794ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf file = illumos-utils/src/zone.rs:363
10782024-11-09T01:21:51.798ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265 file = illumos-utils/src/zone.rs:363
10792024-11-09T01:21:51.802ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940 file = illumos-utils/src/zone.rs:363
10802024-11-09T01:21:51.807ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194 file = illumos-utils/src/zone.rs:363
10812024-11-09T01:21:51.812ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1 file = illumos-utils/src/zone.rs:363
10822024-11-09T01:21:51.818ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee file = illumos-utils/src/zone.rs:363
10832024-11-09T01:21:51.822ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5 file = illumos-utils/src/zone.rs:325
10842024-11-09T01:21:51.827ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0 file = illumos-utils/src/zone.rs:325
10852024-11-09T01:21:51.833ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e file = illumos-utils/src/zone.rs:325
10862024-11-09T01:21:51.837ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b file = illumos-utils/src/zone.rs:325
10872024-11-09T01:21:51.842ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36 file = illumos-utils/src/zone.rs:325
10882024-11-09T01:21:51.848ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7 file = illumos-utils/src/zone.rs:325
10892024-11-09T01:21:51.855ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b file = illumos-utils/src/zone.rs:325
10902024-11-09T01:21:51.915ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10912024-11-09T01:21:51.915ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5 file = illumos-utils/src/zone.rs:363
10922024-11-09T01:21:51.925ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0 file = illumos-utils/src/zone.rs:363
10932024-11-09T01:21:51.933ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e file = illumos-utils/src/zone.rs:363
10942024-11-09T01:21:51.940ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b file = illumos-utils/src/zone.rs:363
10952024-11-09T01:21:51.948ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36 file = illumos-utils/src/zone.rs:363
10962024-11-09T01:21:51.957ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7 file = illumos-utils/src/zone.rs:363
10972024-11-09T01:21:51.969ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b file = illumos-utils/src/zone.rs:363
10982024-11-09T01:21:52.053ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10992024-11-09T01:21:52.146ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11002024-11-09T01:21:52.208ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11012024-11-09T01:21:52.267ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11022024-11-09T01:21:52.285ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11032024-11-09T01:21:52.285ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11042024-11-09T01:21:52.344ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 230, 61]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11052024-11-09T01:21:52.344ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11062024-11-09T01:21:52.346ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11072024-11-09T01:21:52.346ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11082024-11-09T01:21:52.402ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 216, 92]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11092024-11-09T01:21:52.402ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11102024-11-09T01:21:52.404ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11112024-11-09T01:21:52.404ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11122024-11-09T01:21:52.460ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 237, 112]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11132024-11-09T01:21:52.460ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11142024-11-09T01:21:52.464ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11152024-11-09T01:21:52.464ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11162024-11-09T01:21:52.529ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 178, 166]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11172024-11-09T01:21:52.529ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11182024-11-09T01:21:52.531ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11192024-11-09T01:21:52.531ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11202024-11-09T01:21:52.589ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 146, 203]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11212024-11-09T01:21:52.589ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11222024-11-09T01:21:52.609ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
11232024-11-09T01:21:52.609ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
11242024-11-09T01:21:52.609ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
11252024-11-09T01:21:52.609ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
11262024-11-09T01:21:52.609ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
11272024-11-09T01:21:52.609ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
11282024-11-09T01:21:52.609ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
11292024-11-09T01:21:52.609ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
11302024-11-09T01:21:52.611ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
11312024-11-09T01:21:52.611ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
11322024-11-09T01:21:52.628ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
11332024-11-09T01:21:52.629ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11342024-11-09T01:21:52.630ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
11352024-11-09T01:21:52.633ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
11362024-11-09T01:21:52.636ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
11372024-11-09T01:21:52.637ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11382024-11-09T01:21:52.637ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11392024-11-09T01:21:52.641ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
11402024-11-09T01:21:52.645ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11412024-11-09T01:21:52.645ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11422024-11-09T01:21:53.030ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db file = illumos-utils/src/zone.rs:325
11432024-11-09T01:21:53.041ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357 file = illumos-utils/src/zone.rs:325
11442024-11-09T01:21:53.050ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6 file = illumos-utils/src/zone.rs:325
11452024-11-09T01:21:53.059ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a file = illumos-utils/src/zone.rs:325
11462024-11-09T01:21:53.066ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9 file = illumos-utils/src/zone.rs:325
11472024-11-09T01:21:53.073ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db file = illumos-utils/src/zone.rs:363
11482024-11-09T01:21:53.080ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357 file = illumos-utils/src/zone.rs:363
11492024-11-09T01:21:53.089ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6 file = illumos-utils/src/zone.rs:363
11502024-11-09T01:21:53.096ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a file = illumos-utils/src/zone.rs:363
11512024-11-09T01:21:53.103ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9 file = illumos-utils/src/zone.rs:363
11522024-11-09T01:22:03.401ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11532024-11-09T01:22:03.426ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7
11542024-11-09T01:22:03.811ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_429a71c0-de37-4c29-9517-d34e0fdea40d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b7b00fc9-e98a-4881-b253-1e6438d50e7b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11552024-11-09T01:22:03.812ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_fb3197ce-1650-4560-94ee-2bc866b44b0e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d335f1d2-91f9-409a-9102-b4e861d6bc77'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11562024-11-09T01:22:03.813ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5
11572024-11-09T01:22:03.824ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1
11582024-11-09T01:22:03.836ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ff1cdd93-8ce7-4ee1-845c-a77798315216/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3686bf7d-f196-427a-bfe8-29d0e498bcc9'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11592024-11-09T01:22:03.837ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_dfa112e2-c0df-4b06-b74f-0a27df3ed293/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='48d0a339-4f98-4e18-aae6-d50330dc05c3'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11602024-11-09T01:22:03.840ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_bf89547e-f293-4d7a-96c8-740a254cce2e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b55b89a3-8fa1-41d7-abff-44867d7e26b9'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11612024-11-09T01:22:03.841ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3ddfa1e2-6686-49f9-839e-ea29e37a9969/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='01d2475f-23ab-4e54-9a88-4a334b75760b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11622024-11-09T01:22:03.841ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e
11632024-11-09T01:22:03.853ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
11642024-11-09T01:22:03.867ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371
11652024-11-09T01:22:03.876ZINFOSledAgent (ServiceManager): Booting oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940
11662024-11-09T01:22:04.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7") failed: Property not found. retry in 44.698027ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7
11672024-11-09T01:22:04.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940") failed: Property not found. retry in 36.156022ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940
11682024-11-09T01:22:04.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1") failed: Property not found. retry in 47.803276ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1
11692024-11-09T01:22:04.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5") failed: Property not found. retry in 25.809165ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5
11702024-11-09T01:22:04.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e") failed: Property not found. retry in 52.575622ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e
11712024-11-09T01:22:04.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36") failed: Property not found. retry in 74.47135ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
11722024-11-09T01:22:04.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371") failed: Property not found. retry in 59.166813ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371
11732024-11-09T01:22:04.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940") failed: Property not found. retry in 123.266566ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940
11742024-11-09T01:22:04.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7") failed: Property not found. retry in 105.985365ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7
11752024-11-09T01:22:04.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1") failed: Property not found. retry in 106.691151ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1
11762024-11-09T01:22:04.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5") failed: Property not found. retry in 90.320989ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5
11772024-11-09T01:22:04.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e") failed: Property not found. retry in 96.178232ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e
11782024-11-09T01:22:04.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371") failed: Property not found. retry in 115.07647ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371
11792024-11-09T01:22:04.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36") failed: Property not found. retry in 122.205081ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
11802024-11-09T01:22:04.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7") failed: Property not found. retry in 195.72822ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7
11812024-11-09T01:22:04.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940") failed: Property not found. retry in 240.251443ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940
11822024-11-09T01:22:04.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1") failed: Property not found. retry in 285.661166ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1
11832024-11-09T01:22:04.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5") failed: Property not found. retry in 121.292055ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5
11842024-11-09T01:22:04.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e") failed: Property not found. retry in 296.400457ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e
11852024-11-09T01:22:04.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371") failed: Property not found. retry in 252.156608ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371
11862024-11-09T01:22:04.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36") failed: Property not found. retry in 175.831318ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
11872024-11-09T01:22:04.953ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11882024-11-09T01:22:04.953ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265
11892024-11-09T01:22:05.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5") failed: Property not found. retry in 266.88147ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5
11902024-11-09T01:22:05.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7") failed: Property not found. retry in 417.851862ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7
11912024-11-09T01:22:05.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36") failed: Property not found. retry in 569.998582ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
11922024-11-09T01:22:05.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940") failed: Property not found. retry in 484.269905ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940
11932024-11-09T01:22:05.101ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ab413033-915c-42e6-846f-3f01a7447749/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='fac703c8-831a-4af0-bb9b-4a0c8944e8e1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11942024-11-09T01:22:05.102ZINFOSledAgent (ServiceManager): Booting oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee
11952024-11-09T01:22:05.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371") failed: Property not found. retry in 569.291635ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371
11962024-11-09T01:22:05.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1") failed: Property not found. retry in 260.680323ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1
11972024-11-09T01:22:05.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e") failed: Property not found. retry in 523.321538ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e
11982024-11-09T01:22:05.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265") failed: Property not found. retry in 57.464645ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265
11992024-11-09T01:22:05.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265") failed: Property not found. retry in 67.162248ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265
12002024-11-09T01:22:05.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5") failed: Property not found. retry in 515.649503ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5
12012024-11-09T01:22:05.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee") failed: Property not found. retry in 31.637077ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee
12022024-11-09T01:22:05.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265") failed: Property not found. retry in 220.279156ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265
12032024-11-09T01:22:05.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee") failed: Property not found. retry in 136.63663ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee
12042024-11-09T01:22:05.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1") failed: Property not found. retry in 1.197799511s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1
12052024-11-09T01:22:05.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7") failed: Property not found. retry in 480.829336ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7
12062024-11-09T01:22:05.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee") failed: Property not found. retry in 132.46827ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee
12072024-11-09T01:22:05.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265") failed: Property not found. retry in 547.161229ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265
12082024-11-09T01:22:05.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940") failed: Property not found. retry in 1.143706876s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940
12092024-11-09T01:22:05.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36") failed: Property not found. retry in 832.562692ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
12102024-11-09T01:22:05.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee") failed: Property not found. retry in 568.98323ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee
12112024-11-09T01:22:05.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e") failed: Property not found. retry in 499.327635ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e
12122024-11-09T01:22:05.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371") failed: Property not found. retry in 1.164313257s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371
12132024-11-09T01:22:05.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5") failed: Property not found. retry in 1.219976504s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5
12142024-11-09T01:22:05.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7") failed: Property not found. retry in 771.558149ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7
12152024-11-09T01:22:06.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265") failed: Property not found. retry in 1.006022594s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265
12162024-11-09T01:22:06.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e") failed: Property not found. retry in 728.529951ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e
12172024-11-09T01:22:06.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee") failed: Property not found. retry in 1.074783948s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee
12182024-11-09T01:22:06.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36") failed: Property not found. retry in 674.932216ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
12192024-11-09T01:22:06.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1") failed: Property not found. retry in 784.449571ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1
12202024-11-09T01:22:06.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7") failed: Property not found. retry in 799.043356ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7
12212024-11-09T01:22:06.751ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12222024-11-09T01:22:06.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940") failed: Property not found. retry in 989.239395ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940
12232024-11-09T01:22:06.770ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194
12242024-11-09T01:22:06.944ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.287462756s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
12252024-11-09T01:22:06.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371") failed: Property not found. retry in 784.949261ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371
12262024-11-09T01:22:06.968ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3b61ae58-143a-47f2-a80d-e4aeb0c981fa/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5515c137-be92-4c3f-97f4-b68dd00df232'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12272024-11-09T01:22:06.995ZINFOSledAgent (ServiceManager): Booting oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf
12282024-11-09T01:22:07.005ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12292024-11-09T01:22:07.014ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12302024-11-09T01:22:07.014ZINFOSledAgent (ServiceManager): Booting oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357
12312024-11-09T01:22:07.026ZINFOSledAgent (ServiceManager): Booting oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9
12322024-11-09T01:22:07.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5") failed: Property not found. retry in 1.441933655s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5
12332024-11-09T01:22:07.060ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1f0e3af0-a7d2-464f-9192-4fe81acc94c1/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='68eb286f-0892-48be-b292-b5c3dd80f96b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12342024-11-09T01:22:07.060ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0
12352024-11-09T01:22:07.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e") failed: Property not found. retry in 611.264289ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e
12362024-11-09T01:22:07.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194") failed: Property not found. retry in 45.303672ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194
12372024-11-09T01:22:07.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265") failed: Property not found. retry in 1.33228218s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265
12382024-11-09T01:22:07.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36") failed: Property not found. retry in 666.816169ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
12392024-11-09T01:22:07.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194") failed: Property not found. retry in 50.810683ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194
12402024-11-09T01:22:07.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357") failed: Property not found. retry in 28.525645ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357
12412024-11-09T01:22:07.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf") failed: Property not found. retry in 70.393916ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf
12422024-11-09T01:22:07.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9") failed: Property not found. retry in 35.620295ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9
12432024-11-09T01:22:07.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357") failed: Property not found. retry in 55.87917ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357
12442024-11-09T01:22:07.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194") failed: Property not found. retry in 172.135059ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194
12452024-11-09T01:22:07.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf") failed: Property not found. retry in 93.480231ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf
12462024-11-09T01:22:07.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9") failed: Property not found. retry in 105.423762ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9
12472024-11-09T01:22:07.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0") failed: Property not found. retry in 44.359318ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0
12482024-11-09T01:22:07.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357") failed: Property not found. retry in 222.483912ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357
12492024-11-09T01:22:07.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1") failed: Property not found. retry in 524.706316ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1
12502024-11-09T01:22:07.484ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12512024-11-09T01:22:07.484ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a
12522024-11-09T01:22:07.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee") failed: Property not found. retry in 608.499046ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee
12532024-11-09T01:22:07.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0") failed: Property not found. retry in 133.672925ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0
12542024-11-09T01:22:07.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf") failed: Property not found. retry in 123.264489ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf
12552024-11-09T01:22:07.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7") failed: Property not found. retry in 1.155617524s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7
12562024-11-09T01:22:07.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9") failed: Property not found. retry in 103.488513ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9
12572024-11-09T01:22:07.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194") failed: Property not found. retry in 380.919803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194
12582024-11-09T01:22:07.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0") failed: Property not found. retry in 158.116578ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0
12592024-11-09T01:22:07.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf") failed: Property not found. retry in 338.4322ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf
12602024-11-09T01:22:07.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9") failed: Property not found. retry in 537.332973ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9
12612024-11-09T01:22:07.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357") failed: Property not found. retry in 560.882074ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357
12622024-11-09T01:22:07.745ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='c1f5f1ac-115a-4364-9c55-c9fb1352920b'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12632024-11-09T01:22:07.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a") failed: Property not found. retry in 27.373304ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a
12642024-11-09T01:22:07.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e") failed: Property not found. retry in 699.900764ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e
12652024-11-09T01:22:07.785ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b
12662024-11-09T01:22:07.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371") failed: Property not found. retry in 1.245696189s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371
12672024-11-09T01:22:07.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940") failed: Property not found. retry in 745.034724ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940
12682024-11-09T01:22:07.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a") failed: Property not found. retry in 50.308806ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a
12692024-11-09T01:22:07.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0") failed: Property not found. retry in 534.646488ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0
12702024-11-09T01:22:07.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a") failed: Property not found. retry in 194.89749ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a
12712024-11-09T01:22:07.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36") failed: Property not found. retry in 589.896301ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
12722024-11-09T01:22:08.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194") failed: Property not found. retry in 1.094941914s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194
12732024-11-09T01:22:08.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1") failed: Property not found. retry in 725.500438ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1
12742024-11-09T01:22:08.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf") failed: Property not found. retry in 916.606058ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf
12752024-11-09T01:22:08.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b") failed: Property not found. retry in 46.708427ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b
12762024-11-09T01:22:08.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b") failed: Property not found. retry in 106.800265ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b
12772024-11-09T01:22:08.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a") failed: Property not found. retry in 374.293685ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a
12782024-11-09T01:22:08.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee") failed: Property not found. retry in 877.870415ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee
12792024-11-09T01:22:08.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b") failed: Property not found. retry in 183.955263ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b
12802024-11-09T01:22:08.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9") failed: Property not found. retry in 621.274819ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9
12812024-11-09T01:22:08.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357") failed: Property not found. retry in 669.372578ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357
12822024-11-09T01:22:08.316ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12832024-11-09T01:22:08.316ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6
12842024-11-09T01:22:08.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0") failed: Property not found. retry in 979.633462ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0
12852024-11-09T01:22:08.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b") failed: Property not found. retry in 522.266798ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b
12862024-11-09T01:22:08.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e") failed: Property not found. retry in 831.952201ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e
12872024-11-09T01:22:08.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a") failed: Property not found. retry in 1.138154337s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a
12882024-11-09T01:22:08.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5") failed: Property not found. retry in 1.319951444s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5
12892024-11-09T01:22:08.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36") failed: Property not found. retry in 1.166843031s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
12902024-11-09T01:22:08.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265") failed: Property not found. retry in 911.29817ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265
12912024-11-09T01:22:08.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940") failed: Property not found. retry in 1.452208051s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940
12922024-11-09T01:22:08.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6") failed: Property not found. retry in 54.851696ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6
12932024-11-09T01:22:08.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7") failed: Property not found. retry in 931.093162ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7
12942024-11-09T01:22:08.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1") failed: Property not found. retry in 717.196625ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1
12952024-11-09T01:22:08.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6") failed: Property not found. retry in 69.118661ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6
12962024-11-09T01:22:08.792ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12972024-11-09T01:22:08.792ZINFOSledAgent (ServiceManager): Booting oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db
12982024-11-09T01:22:08.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6") failed: Property not found. retry in 158.415703ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6
12992024-11-09T01:22:08.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9") failed: Property not found. retry in 505.174511ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9
13002024-11-09T01:22:08.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf") failed: Property not found. retry in 1.366202746s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf
13012024-11-09T01:22:09.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357") failed: Property not found. retry in 773.237709ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357
13022024-11-09T01:22:09.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b") failed: Property not found. retry in 462.01033ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b
13032024-11-09T01:22:09.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee") failed: Property not found. retry in 1.312188013s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee
13042024-11-09T01:22:09.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6") failed: Property not found. retry in 403.608086ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6
13052024-11-09T01:22:09.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371") failed: Property not found. retry in 1.291576619s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371
13062024-11-09T01:22:09.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194") failed: Property not found. retry in 1.035005822s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194
13072024-11-09T01:22:09.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db") failed: Property not found. retry in 70.600558ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db
13082024-11-09T01:22:09.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db") failed: Property not found. retry in 118.15796ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db
13092024-11-09T01:22:09.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e") failed: Property not found. retry in 1.408275802s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e
13102024-11-09T01:22:09.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db") failed: Property not found. retry in 147.420436ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db
13112024-11-09T01:22:09.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0") failed: Property not found. retry in 502.694119ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0
13122024-11-09T01:22:09.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9") failed: Property not found. retry in 861.214216ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9
13132024-11-09T01:22:09.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6") failed: Property not found. retry in 641.749425ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6
13142024-11-09T01:22:09.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b") failed: Property not found. retry in 1.126529258s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b
13152024-11-09T01:22:09.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1") failed: Property not found. retry in 1.036241058s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1
13162024-11-09T01:22:09.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265") failed: Property not found. retry in 770.996335ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265
13172024-11-09T01:22:09.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db") failed: Property not found. retry in 357.500122ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db
13182024-11-09T01:22:09.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a") failed: Property not found. retry in 596.123834ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a
13192024-11-09T01:22:09.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7") failed: Property not found. retry in 1.457769926s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7
13202024-11-09T01:22:09.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36") failed: Property not found. retry in 813.738383ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
13212024-11-09T01:22:09.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357") failed: Property not found. retry in 754.032623ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357
13222024-11-09T01:22:09.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5") failed: Property not found. retry in 1.061853944s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5
13232024-11-09T01:22:09.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0") failed: Property not found. retry in 1.18775369s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0
13242024-11-09T01:22:09.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db") failed: Property not found. retry in 1.069591477s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db
13252024-11-09T01:22:10.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940") failed: Property not found. retry in 1.076468884s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940
13262024-11-09T01:22:10.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6") failed: Property not found. retry in 1.263653093s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6
13272024-11-09T01:22:10.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194") failed: Property not found. retry in 1.489982235s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194
13282024-11-09T01:22:10.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a") failed: Property not found. retry in 977.424085ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a
13292024-11-09T01:22:10.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9") failed: Property not found. retry in 1.333754258s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9
13302024-11-09T01:22:10.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265") failed: Property not found. retry in 1.078604123s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265
13312024-11-09T01:22:10.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf") failed: Property not found. retry in 897.662883ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf
13322024-11-09T01:22:10.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee") failed: Property not found. retry in 516.725742ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee
13332024-11-09T01:22:10.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371") failed: Property not found. retry in 1.439589927s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371
13342024-11-09T01:22:10.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357") failed: Property not found. retry in 1.292045138s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357
13352024-11-09T01:22:10.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1") failed: Property not found. retry in 967.174606ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1
13362024-11-09T01:22:10.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36") failed: Property not found. retry in 1.451945778s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
13372024-11-09T01:22:10.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b") failed: Property not found. retry in 774.347003ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b
13382024-11-09T01:22:10.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e") failed: Property not found. retry in 915.197745ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e
13392024-11-09T01:22:10.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee") failed: Property not found. retry in 1.223389977s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee
13402024-11-09T01:22:10.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5") failed: Property not found. retry in 1.048023915s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5
13412024-11-09T01:22:11.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db") failed: Property not found. retry in 751.238256ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db
13422024-11-09T01:22:11.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0") failed: Property not found. retry in 973.080192ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0
13432024-11-09T01:22:11.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7") failed: Property not found. retry in 1.317014105s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7
13442024-11-09T01:22:11.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940") failed: Property not found. retry in 617.67704ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940
13452024-11-09T01:22:11.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf") failed: Property not found. retry in 1.065104664s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf
13462024-11-09T01:22:11.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a") failed: Property not found. retry in 589.449233ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a
13472024-11-09T01:22:11.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6") failed: Property not found. retry in 999.472343ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6
13482024-11-09T01:22:11.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265") failed: Property not found. retry in 616.382908ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265
13492024-11-09T01:22:11.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b") failed: Property not found. retry in 1.308777149s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b
13502024-11-09T01:22:11.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1") failed: Property not found. retry in 1.298214547s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1
13512024-11-09T01:22:11.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9") failed: Property not found. retry in 1.420432282s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9
13522024-11-09T01:22:11.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194") failed: Property not found. retry in 572.062375ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194
13532024-11-09T01:22:11.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e") failed: Property not found. retry in 1.010291144s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e
13542024-11-09T01:22:11.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db") failed: Property not found. retry in 609.44727ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db
13552024-11-09T01:22:11.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940") failed: Property not found. retry in 1.456332081s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940
13562024-11-09T01:22:11.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371") failed: Property not found. retry in 829.58779ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371
13572024-11-09T01:22:11.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357") failed: Property not found. retry in 1.474733553s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357
13582024-11-09T01:22:11.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a") failed: Property not found. retry in 1.075990792s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a
13592024-11-09T01:22:12.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5") failed: Property not found. retry in 974.383613ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5
13602024-11-09T01:22:12.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265") failed: Property not found. retry in 616.035286ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265
13612024-11-09T01:22:12.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36") failed: Property not found. retry in 841.384908ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
13622024-11-09T01:22:12.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0") failed: Property not found. retry in 1.016876021s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0
13632024-11-09T01:22:12.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee") failed: Property not found. retry in 1.36437533s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee
13642024-11-09T01:22:12.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194") failed: Property not found. retry in 577.763535ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194
13652024-11-09T01:22:12.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf") failed: Property not found. retry in 853.751073ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf
13662024-11-09T01:22:12.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6") failed: Property not found. retry in 1.400011453s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6
13672024-11-09T01:22:12.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db") failed: Property not found. retry in 821.002817ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db
13682024-11-09T01:22:12.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7") failed: Property not found. retry in 1.374174121s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7
13692024-11-09T01:22:12.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265") failed: Property not found. retry in 1.493925715s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265
13702024-11-09T01:22:12.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371") failed: Property not found. retry in 1.32028298s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371
13712024-11-09T01:22:12.721ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13722024-11-09T01:22:12.722ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b
13732024-11-09T01:22:12.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e") failed: Property not found. retry in 878.928412ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e
13742024-11-09T01:22:12.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b") failed: Property not found. retry in 820.896136ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b
13752024-11-09T01:22:12.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194") failed: Property not found. retry in 958.723387ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194
13762024-11-09T01:22:12.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1") failed: Property not found. retry in 1.198199723s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1
13772024-11-09T01:22:12.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36") failed: Property not found. retry in 1.014311799s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
13782024-11-09T01:22:12.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a") failed: Property not found. retry in 1.486961968s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a
13792024-11-09T01:22:13.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5") failed: Property not found. retry in 1.020552587s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5
13802024-11-09T01:22:13.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b") failed: Property not found. retry in 66.9511ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b
13812024-11-09T01:22:13.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9") failed: Property not found. retry in 1.424216275s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9
13822024-11-09T01:22:13.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0") failed: Property not found. retry in 549.240088ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0
13832024-11-09T01:22:13.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b") failed: Property not found. retry in 127.296943ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b
13842024-11-09T01:22:13.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf") failed: Property not found. retry in 1.198473502s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf
13852024-11-09T01:22:13.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940") failed: Property not found. retry in 650.998833ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940
13862024-11-09T01:22:13.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357") failed: Property not found. retry in 1.197914067s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357
13872024-11-09T01:22:13.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b") failed: Property not found. retry in 218.400175ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b
13882024-11-09T01:22:13.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db") failed: Property not found. retry in 1.382298718s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db
13892024-11-09T01:22:13.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee") failed: Property not found. retry in 962.878379ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee
13902024-11-09T01:22:13.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b") failed: Property not found. retry in 1.05111061s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b
13912024-11-09T01:22:13.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e") failed: Property not found. retry in 1.357658234s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e
13922024-11-09T01:22:13.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b") failed: Property not found. retry in 393.04719ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b
13932024-11-09T01:22:13.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0") failed: Property not found. retry in 750.819146ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0
13942024-11-09T01:22:13.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6") failed: Property not found. retry in 1.488126873s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6
13952024-11-09T01:22:13.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194") failed: Property not found. retry in 882.042471ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194
13962024-11-09T01:22:13.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36") failed: Property not found. retry in 1.016524564s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
13972024-11-09T01:22:14.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7") failed: Property not found. retry in 1.239513696s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7
13982024-11-09T01:22:14.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371") failed: Property not found. retry in 1.428315083s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371
13992024-11-09T01:22:14.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940") failed: Property not found. retry in 1.158267296s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940
14002024-11-09T01:22:14.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1") failed: Property not found. retry in 1.426768584s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1
14012024-11-09T01:22:14.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5") failed: Property not found. retry in 974.708262ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5
14022024-11-09T01:22:14.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b") failed: Property not found. retry in 1.034012089s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b
14032024-11-09T01:22:14.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265") failed: Property not found. retry in 536.199971ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265
14042024-11-09T01:22:14.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0") failed: Property not found. retry in 802.983658ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0
14052024-11-09T01:22:14.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a") failed: Property not found. retry in 790.372274ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a
14062024-11-09T01:22:14.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee") failed: Property not found. retry in 995.607393ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee
14072024-11-09T01:22:14.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9") failed: Property not found. retry in 991.10564ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9
14082024-11-09T01:22:14.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf") failed: Property not found. retry in 1.219179758s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf
14092024-11-09T01:22:14.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357") failed: Property not found. retry in 508.394603ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357
14102024-11-09T01:22:14.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b") failed: Property not found. retry in 1.273403302s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b
14112024-11-09T01:22:14.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194") failed: Property not found. retry in 671.633901ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194
14122024-11-09T01:22:14.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db") failed: Property not found. retry in 673.924369ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db
14132024-11-09T01:22:14.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265") failed: Property not found. retry in 1.342263913s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265
14142024-11-09T01:22:15.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e") failed: Property not found. retry in 717.687058ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e
14152024-11-09T01:22:15.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36") failed: Property not found. retry in 1.409775513s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
14162024-11-09T01:22:15.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357") failed: Property not found. retry in 1.057632949s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357
14172024-11-09T01:22:15.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5") failed: Property not found. retry in 939.203874ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5
14182024-11-09T01:22:15.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a") failed: Property not found. retry in 1.243980504s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a
14192024-11-09T01:22:15.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0") failed: Property not found. retry in 753.619082ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0
14202024-11-09T01:22:15.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7") failed: Property not found. retry in 960.803333ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7
14212024-11-09T01:22:15.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b") failed: Property not found. retry in 902.871957ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b
14222024-11-09T01:22:15.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6") failed: Property not found. retry in 1.28582158s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6
14232024-11-09T01:22:15.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940") failed: Property not found. retry in 1.262844452s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940
14242024-11-09T01:22:15.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371") failed: Property not found. retry in 1.418732718s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371
14252024-11-09T01:22:15.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194") failed: Property not found. retry in 1.13295802s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194
14262024-11-09T01:22:15.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee") failed: Property not found. retry in 1.171848836s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee
14272024-11-09T01:22:15.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db") failed: Property not found. retry in 549.72937ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db
14282024-11-09T01:22:15.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9") failed: Property not found. retry in 924.106773ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9
14292024-11-09T01:22:15.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1") failed: Property not found. retry in 1.418120639s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1
14302024-11-09T01:22:15.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e") failed: Property not found. retry in 1.479338137s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e
14312024-11-09T01:22:15.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf") failed: Property not found. retry in 1.477182227s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf
14322024-11-09T01:22:16.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b") failed: Property not found. retry in 982.530285ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b
14332024-11-09T01:22:16.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0") failed: Property not found. retry in 814.922792ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0
14342024-11-09T01:22:16.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db") failed: Property not found. retry in 1.170064511s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db
14352024-11-09T01:22:16.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5") failed: Property not found. retry in 1.4619741s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5
14362024-11-09T01:22:16.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b") failed: Property not found. retry in 1.170108787s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b
14372024-11-09T01:22:16.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7") failed: Property not found. retry in 1.303043265s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7
14382024-11-09T01:22:16.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265") failed: Property not found. retry in 1.374058106s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265
14392024-11-09T01:22:16.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357") failed: Property not found. retry in 1.054768032s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357
14402024-11-09T01:22:16.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36") failed: Property not found. retry in 920.37993ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
14412024-11-09T01:22:16.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a") failed: Property not found. retry in 581.071471ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a
14422024-11-09T01:22:16.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9") failed: Property not found. retry in 1.047171768s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9
14432024-11-09T01:22:16.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940") failed: Property not found. retry in 1.354315374s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940
14442024-11-09T01:22:16.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6") failed: Property not found. retry in 830.940044ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6
14452024-11-09T01:22:16.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194") failed: Property not found. retry in 770.725783ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194
14462024-11-09T01:22:16.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee") failed: Property not found. retry in 528.639666ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee
14472024-11-09T01:22:16.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0") failed: Property not found. retry in 1.478079228s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0
14482024-11-09T01:22:16.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371") failed: Property not found. retry in 1.056099284s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371
14492024-11-09T01:22:17.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b") failed: Property not found. retry in 701.149026ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b
14502024-11-09T01:22:17.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a") failed: Property not found. retry in 1.025879485s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a
14512024-11-09T01:22:17.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee") failed: Property not found. retry in 1.497114681s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee
14522024-11-09T01:22:17.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db") failed: Property not found. retry in 1.045545563s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db
14532024-11-09T01:22:17.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36") failed: Property not found. retry in 933.414769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
14542024-11-09T01:22:17.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357") failed: Property not found. retry in 542.569716ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357
14552024-11-09T01:22:17.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf") failed: Property not found. retry in 666.218478ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf
14562024-11-09T01:22:17.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b") failed: Property not found. retry in 888.146313ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b
14572024-11-09T01:22:17.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6") failed: Property not found. retry in 1.368864658s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6
14582024-11-09T01:22:17.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194") failed: Property not found. retry in 1.090102524s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194
14592024-11-09T01:22:17.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7") failed: Property not found. retry in 1.054694223s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7
14602024-11-09T01:22:17.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9") failed: Property not found. retry in 1.396548477s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9
14612024-11-09T01:22:17.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5") failed: Property not found. retry in 617.467921ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5
14622024-11-09T01:22:17.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265") failed: Property not found. retry in 1.083926363s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265
14632024-11-09T01:22:17.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b") failed: Property not found. retry in 1.477981482s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b
14642024-11-09T01:22:17.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357") failed: Property not found. retry in 1.323923146s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357
14652024-11-09T01:22:17.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940") failed: Property not found. retry in 964.296139ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940
14662024-11-09T01:22:18.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371") failed: Property not found. retry in 552.475501ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371
14672024-11-09T01:22:18.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf") failed: Property not found. retry in 1.464641924s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf
14682024-11-09T01:22:18.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36") failed: Property not found. retry in 648.970208ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
14692024-11-09T01:22:18.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5") failed: Property not found. retry in 1.434643752s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5
14702024-11-09T01:22:18.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a") failed: Property not found. retry in 651.428481ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a
14712024-11-09T01:22:18.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b") failed: Property not found. retry in 665.64105ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b
14722024-11-09T01:22:18.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0") failed: Property not found. retry in 1.270072414s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0
14732024-11-09T01:22:18.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db") failed: Property not found. retry in 1.271373219s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db
14742024-11-09T01:22:18.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194") failed: Property not found. retry in 560.312154ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194
14752024-11-09T01:22:18.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371") failed: Property not found. retry in 1.288850793s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371
14762024-11-09T01:22:18.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7") failed: Property not found. retry in 642.278333ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7
14772024-11-09T01:22:18.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265") failed: Property not found. retry in 1.386511309s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265
14782024-11-09T01:22:18.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee") failed: Property not found. retry in 795.439801ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee
14792024-11-09T01:22:18.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6") failed: Property not found. retry in 1.290790275s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6
14802024-11-09T01:22:18.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940") failed: Property not found. retry in 1.18831992s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940
14812024-11-09T01:22:18.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36") failed: Property not found. retry in 1.12278699s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
14822024-11-09T01:22:18.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a") failed: Property not found. retry in 1.319876772s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a
14832024-11-09T01:22:19.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b") failed: Property not found. retry in 1.326205554s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b
14842024-11-09T01:22:19.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9") failed: Property not found. retry in 1.044065686s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9
14852024-11-09T01:22:19.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194") failed: Property not found. retry in 526.208017ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194
14862024-11-09T01:22:19.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b") failed: Property not found. retry in 998.881714ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b
14872024-11-09T01:22:19.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357") failed: Property not found. retry in 1.296147394s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357
14882024-11-09T01:22:19.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7") failed: Property not found. retry in 945.194897ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7
14892024-11-09T01:22:19.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf") failed: Property not found. retry in 1.342130855s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf
14902024-11-09T01:22:19.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee") failed: Property not found. retry in 639.324598ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee
14912024-11-09T01:22:19.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0") failed: Property not found. retry in 911.052421ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0
14922024-11-09T01:22:19.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db") failed: Property not found. retry in 537.630243ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db
14932024-11-09T01:22:19.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194") failed: Property not found. retry in 646.012407ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194
14942024-11-09T01:22:19.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5") failed: Property not found. retry in 1.347386572s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5
14952024-11-09T01:22:19.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371") failed: Property not found. retry in 525.490918ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371
14962024-11-09T01:22:20.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9") failed: Property not found. retry in 1.164708855s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9
14972024-11-09T01:22:20.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36") failed: Property not found. retry in 860.141531ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
14982024-11-09T01:22:20.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940") failed: Property not found. retry in 1.418422965s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940
14992024-11-09T01:22:20.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6") failed: Property not found. retry in 833.680667ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6
15002024-11-09T01:22:20.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265") failed: Property not found. retry in 1.09193941s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265
15012024-11-09T01:22:20.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db") failed: Property not found. retry in 1.196469158s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db
15022024-11-09T01:22:20.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b") failed: Property not found. retry in 853.505658ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b
15032024-11-09T01:22:20.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7") failed: Property not found. retry in 1.10434159s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7
15042024-11-09T01:22:20.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee") failed: Property not found. retry in 983.454361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee
15052024-11-09T01:22:20.294ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42631
15062024-11-09T01:22:20.318ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 13273 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42631 req_id = e4a34c81-2d9b-4ee5-a815-f61d6c69f1fd response_code = 200 uri = /baseboard
15072024-11-09T01:22:20.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a") failed: Property not found. retry in 769.070187ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a
15082024-11-09T01:22:20.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b") failed: Property not found. retry in 1.020909715s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b
15092024-11-09T01:22:20.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194") failed: Property not found. retry in 1.048776839s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194
15102024-11-09T01:22:20.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371") failed: Property not found. retry in 542.792878ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371
15112024-11-09T01:22:20.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0") failed: Property not found. retry in 913.629153ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0
15122024-11-09T01:22:20.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357") failed: Property not found. retry in 1.227169191s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357
15132024-11-09T01:22:20.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf") failed: Property not found. retry in 794.348751ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf
15142024-11-09T01:22:20.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36") failed: Property not found. retry in 604.639212ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
15152024-11-09T01:22:21.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371") failed: Property not found. retry in 1.273840038s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371
15162024-11-09T01:22:21.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6") failed: Property not found. retry in 682.714332ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6
15172024-11-09T01:22:21.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a") failed: Property not found. retry in 1.260293141s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a
15182024-11-09T01:22:21.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b") failed: Property not found. retry in 966.587296ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b
15192024-11-09T01:22:21.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5") failed: Property not found. retry in 1.194981086s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5
15202024-11-09T01:22:21.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee") failed: Property not found. retry in 595.022242ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee
15212024-11-09T01:22:21.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9") failed: Property not found. retry in 539.01828ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9
15222024-11-09T01:22:21.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265") failed: Property not found. retry in 748.187328ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265
15232024-11-09T01:22:21.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b") failed: Property not found. retry in 1.07236883s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b
15242024-11-09T01:22:21.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194") failed: Property not found. retry in 737.23156ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194
15252024-11-09T01:22:21.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db") failed: Property not found. retry in 513.444915ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db
15262024-11-09T01:22:21.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0") failed: Property not found. retry in 761.117743ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0
15272024-11-09T01:22:21.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36") failed: Property not found. retry in 1.144880445s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
15282024-11-09T01:22:21.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6") failed: Property not found. retry in 983.356933ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6
15292024-11-09T01:22:21.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf") failed: Property not found. retry in 741.756068ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf
15302024-11-09T01:22:21.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9") failed: Property not found. retry in 1.101722879s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9
15312024-11-09T01:22:21.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357") failed: Property not found. retry in 1.43407731s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357
15322024-11-09T01:22:21.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee") failed: Property not found. retry in 569.956015ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee
15332024-11-09T01:22:21.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db") failed: Property not found. retry in 821.560769ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db
15342024-11-09T01:22:22.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265") failed: Property not found. retry in 861.261623ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265
15352024-11-09T01:22:22.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b") failed: Property not found. retry in 578.87215ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b
15362024-11-09T01:22:22.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194") failed: Property not found. retry in 1.001793416s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194
15372024-11-09T01:22:22.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0") failed: Property not found. retry in 1.457901162s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0
15382024-11-09T01:22:22.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371") failed: Property not found. retry in 1.293458983s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371
15392024-11-09T01:22:22.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a") failed: Property not found. retry in 1.400788618s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a
15402024-11-09T01:22:22.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b") failed: Property not found. retry in 962.676246ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b
15412024-11-09T01:22:23.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b") failed: Property not found. retry in 1.016055764s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b
15422024-11-09T01:22:24.322ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.971452241s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
15432024-11-09T01:22:24.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b") failed: Property not found. retry in 781.316173ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b
15442024-11-09T01:22:25.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b") failed: Property not found. retry in 942.594876ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b
15452024-11-09T01:22:26.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b") failed: Property not found. retry in 514.334746ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b
15462024-11-09T01:22:26.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b") failed: Property not found. retry in 1.385511716s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b
15472024-11-09T01:22:28.176ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_0d65eac1-48fd-4fc8-a01f-2a39a8a6e371
15482024-11-09T01:22:28.176ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_58a786ea-0927-458c-8915-fb9e014e3ecf
15492024-11-09T01:22:28.176ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_77d141e8-e3c4-452a-a940-c2c505401265
15502024-11-09T01:22:28.176ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_83d3dd5d-dcb7-4a28-8b95-23a6786f7940
15512024-11-09T01:22:28.176ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_d59d4e08-d131-4d11-8244-662923dd9357
15522024-11-09T01:22:28.176ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_34219892-cef8-4169-a366-ce17844120f6
15532024-11-09T01:22:28.176ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_01a68c16-a577-4363-91a9-597a81dd9194
15542024-11-09T01:22:28.176ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_f53ba5be-5d81-4c31-8175-402f5b6831e1
15552024-11-09T01:22:28.176ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_530f76d0-bec9-4ae0-beb0-d217f68ae05a
15562024-11-09T01:22:28.176ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_02562f58-d954-43f9-93a1-2ae8426ccbe9
15572024-11-09T01:22:28.176ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_827aea44-5b0b-48cf-b23f-23d089e8e9ee
15582024-11-09T01:22:28.176ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_a383ef2b-7c01-4073-9df0-a4815663cea5
15592024-11-09T01:22:28.176ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_b0ef1737-2e70-48dc-ad98-4e77dd6aa0c0
15602024-11-09T01:22:28.176ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_b135bc9d-2a1a-47be-8182-0ff375cf359e
15612024-11-09T01:22:28.176ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_c1f5f1ac-115a-4364-9c55-c9fb1352920b
15622024-11-09T01:22:28.176ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_a2593661-c86b-455e-a9f7-a4c52fc34f36
15632024-11-09T01:22:28.176ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_133f4a57-6a4e-4a37-9ccc-0359ba2b5bb7
15642024-11-09T01:22:28.176ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_4b8e17aa-0aac-4010-9929-5bd5c83a0e4b
15652024-11-09T01:22:28.176ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_86b379c9-5608-41ec-a3b2-837d116869db
15662024-11-09T01:22:28.191ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15672024-11-09T01:22:28.201ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15682024-11-09T01:22:28.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38172294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:54592 req_id = 5c49ac48-e4ec-4fb3-b6fc-f8c8c4af051f response_code = 204 uri = /omicron-zones
15692024-11-09T01:22:28.264ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1446
15702024-11-09T01:22:28.264ZINFOSledAgent (RSS): Writing ledger to /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15712024-11-09T01:22:28.265ZINFOSledAgent (RSS): Writing ledger to /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15722024-11-09T01:22:29.061ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:787
15732024-11-09T01:22:29.116ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:799
15742024-11-09T01:22:29.151ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1011
15752024-11-09T01:22:30.771ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 10.152599214s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
15762024-11-09T01:22:32.591ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/54080907-d4a8-4f65-b867-da4e2da6d2ba/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
15772024-11-09T01:22:32.666ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/54080907-d4a8-4f65-b867-da4e2da6d2ba/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
15782024-11-09T01:22:32.825ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/54080907-d4a8-4f65-b867-da4e2da6d2ba/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
15792024-11-09T01:22:33.027ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/54080907-d4a8-4f65-b867-da4e2da6d2ba/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
15802024-11-09T01:22:33.205ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/54080907-d4a8-4f65-b867-da4e2da6d2ba/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
15812024-11-09T01:22:33.348ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/54080907-d4a8-4f65-b867-da4e2da6d2ba/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
15822024-11-09T01:22:33.583ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/54080907-d4a8-4f65-b867-da4e2da6d2ba/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
15832024-11-09T01:22:33.861ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/54080907-d4a8-4f65-b867-da4e2da6d2ba/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
15842024-11-09T01:22:34.233ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/54080907-d4a8-4f65-b867-da4e2da6d2ba/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
15852024-11-09T01:22:36.145ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "2757f3fc-5c09-494e-9b3f-c4741bce2f6b", "content-length": "173", "date": "Sat, 09 Nov 2024 01:22:36 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"54080907-d4a8-4f65-b867-da4e2da6d2ba\"", request_id: "2757f3fc-5c09-494e-9b3f-c4741bce2f6b" } file = sled-agent/src/rack_setup/service.rs:1073
15862024-11-09T01:22:36.724ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b6fc44b4-9e28-4995-a14c-ce5620ecd650", "content-length": "173", "date": "Sat, 09 Nov 2024 01:22:36 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"54080907-d4a8-4f65-b867-da4e2da6d2ba\"", request_id: "b6fc44b4-9e28-4995-a14c-ce5620ecd650" } file = sled-agent/src/rack_setup/service.rs:1073
15872024-11-09T01:22:37.696ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b2457cea-e3ad-45f8-b62b-7f9f12b02179", "content-length": "173", "date": "Sat, 09 Nov 2024 01:22:37 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"54080907-d4a8-4f65-b867-da4e2da6d2ba\"", request_id: "b2457cea-e3ad-45f8-b62b-7f9f12b02179" } file = sled-agent/src/rack_setup/service.rs:1073
15882024-11-09T01:22:38.147ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0c707544-1fda-4fac-90d1-8d9c0e342e30", "content-length": "173", "date": "Sat, 09 Nov 2024 01:22:37 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"54080907-d4a8-4f65-b867-da4e2da6d2ba\"", request_id: "0c707544-1fda-4fac-90d1-8d9c0e342e30" } file = sled-agent/src/rack_setup/service.rs:1073
15892024-11-09T01:22:40.958ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6c3622ca-5b90-4ae5-9ee7-db38d3ad1971", "content-length": "173", "date": "Sat, 09 Nov 2024 01:22:40 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"8c24f6fb-cc5e-4758-a216-4357bbb5d813\"", request_id: "6c3622ca-5b90-4ae5-9ee7-db38d3ad1971" } file = sled-agent/src/rack_setup/service.rs:1073
15902024-11-09T01:22:43.180ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "bbd8814c-a884-4ea4-9890-9576b4109e06", "content-length": "173", "date": "Sat, 09 Nov 2024 01:22:42 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"8c24f6fb-cc5e-4758-a216-4357bbb5d813\"", request_id: "bbd8814c-a884-4ea4-9890-9576b4109e06" } file = sled-agent/src/rack_setup/service.rs:1073
15912024-11-09T01:22:45.482ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "8c052301-21e2-41b4-82df-8088ea12e6ba", "content-length": "173", "date": "Sat, 09 Nov 2024 01:22:44 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"8c24f6fb-cc5e-4758-a216-4357bbb5d813\"", request_id: "8c052301-21e2-41b4-82df-8088ea12e6ba" } file = sled-agent/src/rack_setup/service.rs:1073
15922024-11-09T01:22:46.555ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "851bdf5a-3fb8-4032-9823-426b900841a0", "content-length": "173", "date": "Sat, 09 Nov 2024 01:22:46 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"8c24f6fb-cc5e-4758-a216-4357bbb5d813\"", request_id: "851bdf5a-3fb8-4032-9823-426b900841a0" } file = sled-agent/src/rack_setup/service.rs:1073
15932024-11-09T01:22:48.420ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "558d5e03-440b-4a88-94e1-4f5d5e1731d4", "content-length": "173", "date": "Sat, 09 Nov 2024 01:22:48 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"8c24f6fb-cc5e-4758-a216-4357bbb5d813\"", request_id: "558d5e03-440b-4a88-94e1-4f5d5e1731d4" } file = sled-agent/src/rack_setup/service.rs:1073
15942024-11-09T01:22:50.158ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:52815 remote_addr = [fd00:1122:3344:101::d]:58027 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
15952024-11-09T01:22:50.196ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34131 local_addr = [fd00:1122:3344:101::1]:52815 method = GET remote_addr = [fd00:1122:3344:101::d]:58027 req_id = b5ea20cb-72a2-4d0c-80b6-001b661976dc response_code = 200 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 uri = /8c24f6fb-cc5e-4758-a216-4357bbb5d813
15962024-11-09T01:22:50.359ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51171
15972024-11-09T01:22:50.359ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51171 req_id = 8b735f94-1a8c-4bcf-ab15-b775a3d2be07 response_code = 200 uri = /baseboard
15982024-11-09T01:22:50.362ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0f6da0cf-68c0-4513-821a-9af2799f06fc", "content-length": "173", "date": "Sat, 09 Nov 2024 01:22:50 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"8c24f6fb-cc5e-4758-a216-4357bbb5d813\"", request_id: "0f6da0cf-68c0-4513-821a-9af2799f06fc" } file = sled-agent/src/rack_setup/service.rs:1073
15992024-11-09T01:22:54.827ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f9dd14ed-916a-4b54-8544-8e83d1e46c47", "content-length": "173", "date": "Sat, 09 Nov 2024 01:22:54 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"8c24f6fb-cc5e-4758-a216-4357bbb5d813\"", request_id: "f9dd14ed-916a-4b54-8544-8e83d1e46c47" } file = sled-agent/src/rack_setup/service.rs:1073
16002024-11-09T01:22:57.504ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7b29554b-6582-41f7-a555-3306b1547ebd", "content-length": "173", "date": "Sat, 09 Nov 2024 01:22:57 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"8c24f6fb-cc5e-4758-a216-4357bbb5d813\"", request_id: "7b29554b-6582-41f7-a555-3306b1547ebd" } file = sled-agent/src/rack_setup/service.rs:1073
16012024-11-09T01:23:03.326ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
16022024-11-09T01:23:03.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58398
16032024-11-09T01:23:03.474ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16042024-11-09T01:23:03.474ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16052024-11-09T01:23:03.475ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/omicron-zones.json file = common/src/ledger.rs:177
16062024-11-09T01:23:03.477ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/omicron-zones.json file = common/src/ledger.rs:177
16072024-11-09T01:23:03.492ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16082024-11-09T01:23:03.492ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ab413033-915c-42e6-846f-3f01a7447749
16092024-11-09T01:23:03.518ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16102024-11-09T01:23:03.518ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1f0e3af0-a7d2-464f-9192-4fe81acc94c1
16112024-11-09T01:23:03.541ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16122024-11-09T01:23:03.541ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_dfa112e2-c0df-4b06-b74f-0a27df3ed293
16132024-11-09T01:23:03.564ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16142024-11-09T01:23:03.564ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ff1cdd93-8ce7-4ee1-845c-a77798315216
16152024-11-09T01:23:03.585ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16162024-11-09T01:23:03.585ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_fb3197ce-1650-4560-94ee-2bc866b44b0e
16172024-11-09T01:23:03.606ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16182024-11-09T01:23:03.606ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3b61ae58-143a-47f2-a80d-e4aeb0c981fa
16192024-11-09T01:23:03.626ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16202024-11-09T01:23:03.626ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3ddfa1e2-6686-49f9-839e-ea29e37a9969
16212024-11-09T01:23:03.645ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 429a71c0-de37-4c29-9517-d34e0fdea40d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16222024-11-09T01:23:03.645ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_429a71c0-de37-4c29-9517-d34e0fdea40d
16232024-11-09T01:23:03.665ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16242024-11-09T01:23:03.665ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bf89547e-f293-4d7a-96c8-740a254cce2e
16252024-11-09T01:23:03.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 208403 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58398 req_id = 36b3ecd2-1ecd-47b8-a5c2-d60b4934d924 response_code = 200 uri = /inventory
16262024-11-09T01:23:04.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59917
16272024-11-09T01:23:04.227ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 49d235c5-d54d-4258-a645-9d181875557a, kind: Service { id: 34219892-cef8-4169-a366-ce17844120f6 }, name: Name("external-dns-34219892-cef8-4169-a366-ce17844120f6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce088bfb-77e0-4498-b680-d4fab72b0123, kind: Service { id: 530f76d0-bec9-4ae0-beb0-d217f68ae05a }, name: Name("external-dns-530f76d0-bec9-4ae0-beb0-d217f68ae05a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 314cfeab-323e-4445-9502-7e16efd0a788, kind: Service { id: 86b379c9-5608-41ec-a3b2-837d116869db }, name: Name("nexus-86b379c9-5608-41ec-a3b2-837d116869db"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9fa251a1-2d97-4513-b670-a39f36efe9c9, kind: Service { id: 02562f58-d954-43f9-93a1-2ae8426ccbe9 }, name: Name("nexus-02562f58-d954-43f9-93a1-2ae8426ccbe9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b1ef6e1e-4501-48bd-9de3-1d5889b6ea55, kind: Service { id: d59d4e08-d131-4d11-8244-662923dd9357 }, name: Name("nexus-d59d4e08-d131-4d11-8244-662923dd9357"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 166])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16282024-11-09T01:23:04.227ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16292024-11-09T01:23:04.227ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16302024-11-09T01:23:04.227ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
16312024-11-09T01:23:04.227ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16322024-11-09T01:23:04.227ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16332024-11-09T01:23:04.227ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16342024-11-09T01:23:04.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4987 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59917 req_id = c44d5a17-f0e8-4fd9-9cc6-bb19e60f8b6c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16352024-11-09T01:23:04.228ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1083
16362024-11-09T01:23:04.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40635
16372024-11-09T01:23:04.542ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16382024-11-09T01:23:04.542ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16392024-11-09T01:23:04.542ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/omicron-zones.json file = common/src/ledger.rs:177
16402024-11-09T01:23:04.542ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/omicron-zones.json file = common/src/ledger.rs:177
16412024-11-09T01:23:04.555ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16422024-11-09T01:23:04.555ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ab413033-915c-42e6-846f-3f01a7447749
16432024-11-09T01:23:04.579ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16442024-11-09T01:23:04.579ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1f0e3af0-a7d2-464f-9192-4fe81acc94c1
16452024-11-09T01:23:04.599ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16462024-11-09T01:23:04.599ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_dfa112e2-c0df-4b06-b74f-0a27df3ed293
16472024-11-09T01:23:04.620ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16482024-11-09T01:23:04.620ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ff1cdd93-8ce7-4ee1-845c-a77798315216
16492024-11-09T01:23:04.640ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16502024-11-09T01:23:04.640ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_fb3197ce-1650-4560-94ee-2bc866b44b0e
16512024-11-09T01:23:04.660ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16522024-11-09T01:23:04.660ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3b61ae58-143a-47f2-a80d-e4aeb0c981fa
16532024-11-09T01:23:04.680ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16542024-11-09T01:23:04.681ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3ddfa1e2-6686-49f9-839e-ea29e37a9969
16552024-11-09T01:23:04.700ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 429a71c0-de37-4c29-9517-d34e0fdea40d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16562024-11-09T01:23:04.700ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_429a71c0-de37-4c29-9517-d34e0fdea40d
16572024-11-09T01:23:04.719ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16582024-11-09T01:23:04.719ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bf89547e-f293-4d7a-96c8-740a254cce2e
16592024-11-09T01:23:04.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 188819 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40635 req_id = c5c21a3b-9a18-4b21-b354-3909ab6f4973 response_code = 200 uri = /inventory
16602024-11-09T01:23:04.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57821
16612024-11-09T01:23:04.763ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 49d235c5-d54d-4258-a645-9d181875557a, kind: Service { id: 34219892-cef8-4169-a366-ce17844120f6 }, name: Name("external-dns-34219892-cef8-4169-a366-ce17844120f6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce088bfb-77e0-4498-b680-d4fab72b0123, kind: Service { id: 530f76d0-bec9-4ae0-beb0-d217f68ae05a }, name: Name("external-dns-530f76d0-bec9-4ae0-beb0-d217f68ae05a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 314cfeab-323e-4445-9502-7e16efd0a788, kind: Service { id: 86b379c9-5608-41ec-a3b2-837d116869db }, name: Name("nexus-86b379c9-5608-41ec-a3b2-837d116869db"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9fa251a1-2d97-4513-b670-a39f36efe9c9, kind: Service { id: 02562f58-d954-43f9-93a1-2ae8426ccbe9 }, name: Name("nexus-02562f58-d954-43f9-93a1-2ae8426ccbe9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b1ef6e1e-4501-48bd-9de3-1d5889b6ea55, kind: Service { id: d59d4e08-d131-4d11-8244-662923dd9357 }, name: Name("nexus-d59d4e08-d131-4d11-8244-662923dd9357"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 166])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16622024-11-09T01:23:04.763ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16632024-11-09T01:23:04.764ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16642024-11-09T01:23:04.764ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
16652024-11-09T01:23:04.764ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16662024-11-09T01:23:04.764ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16672024-11-09T01:23:04.764ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16682024-11-09T01:23:04.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 446 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57821 req_id = 3bfe56ad-0c47-4f30-8071-d8a03e4dfba0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16692024-11-09T01:23:05.131ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39547
16702024-11-09T01:23:05.131ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 49d235c5-d54d-4258-a645-9d181875557a, kind: Service { id: 34219892-cef8-4169-a366-ce17844120f6 }, name: Name("external-dns-34219892-cef8-4169-a366-ce17844120f6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce088bfb-77e0-4498-b680-d4fab72b0123, kind: Service { id: 530f76d0-bec9-4ae0-beb0-d217f68ae05a }, name: Name("external-dns-530f76d0-bec9-4ae0-beb0-d217f68ae05a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 314cfeab-323e-4445-9502-7e16efd0a788, kind: Service { id: 86b379c9-5608-41ec-a3b2-837d116869db }, name: Name("nexus-86b379c9-5608-41ec-a3b2-837d116869db"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9fa251a1-2d97-4513-b670-a39f36efe9c9, kind: Service { id: 02562f58-d954-43f9-93a1-2ae8426ccbe9 }, name: Name("nexus-02562f58-d954-43f9-93a1-2ae8426ccbe9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b1ef6e1e-4501-48bd-9de3-1d5889b6ea55, kind: Service { id: d59d4e08-d131-4d11-8244-662923dd9357 }, name: Name("nexus-d59d4e08-d131-4d11-8244-662923dd9357"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 166])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16712024-11-09T01:23:05.131ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16722024-11-09T01:23:05.131ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16732024-11-09T01:23:05.131ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
16742024-11-09T01:23:05.131ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16752024-11-09T01:23:05.132ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16762024-11-09T01:23:05.132ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16772024-11-09T01:23:05.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 482 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39547 req_id = d4333532-d6da-4566-8912-f50829962dfd response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16782024-11-09T01:23:05.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57604
16792024-11-09T01:23:05.699ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 49d235c5-d54d-4258-a645-9d181875557a, kind: Service { id: 34219892-cef8-4169-a366-ce17844120f6 }, name: Name("external-dns-34219892-cef8-4169-a366-ce17844120f6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce088bfb-77e0-4498-b680-d4fab72b0123, kind: Service { id: 530f76d0-bec9-4ae0-beb0-d217f68ae05a }, name: Name("external-dns-530f76d0-bec9-4ae0-beb0-d217f68ae05a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 314cfeab-323e-4445-9502-7e16efd0a788, kind: Service { id: 86b379c9-5608-41ec-a3b2-837d116869db }, name: Name("nexus-86b379c9-5608-41ec-a3b2-837d116869db"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9fa251a1-2d97-4513-b670-a39f36efe9c9, kind: Service { id: 02562f58-d954-43f9-93a1-2ae8426ccbe9 }, name: Name("nexus-02562f58-d954-43f9-93a1-2ae8426ccbe9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b1ef6e1e-4501-48bd-9de3-1d5889b6ea55, kind: Service { id: d59d4e08-d131-4d11-8244-662923dd9357 }, name: Name("nexus-d59d4e08-d131-4d11-8244-662923dd9357"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 166])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16802024-11-09T01:23:05.699ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16812024-11-09T01:23:05.699ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16822024-11-09T01:23:05.699ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
16832024-11-09T01:23:05.699ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16842024-11-09T01:23:05.699ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16852024-11-09T01:23:05.699ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16862024-11-09T01:23:05.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57604 req_id = ba5069d6-2997-44d3-bc3f-088ee5099e80 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16872024-11-09T01:23:09.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54482
16882024-11-09T01:23:09.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1350 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54482 req_id = ba7a4c86-feae-4f1d-bd97-625255248fc8 response_code = 200 uri = /vpc-routes
16892024-11-09T01:23:09.441ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
16902024-11-09T01:23:09.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54482 req_id = 4123bce0-385b-4c11-9773-f958ad43a8ba response_code = 204 uri = /eip-gateways
16912024-11-09T01:23:09.639ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54928
16922024-11-09T01:23:09.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 447 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54928 req_id = 917960fe-9dd6-48d4-98c6-6ccff331e462 response_code = 200 uri = /v2p
16932024-11-09T01:23:09.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57396
16942024-11-09T01:23:09.777ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
16952024-11-09T01:23:09.885ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
16962024-11-09T01:23:09.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 187016 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57396 req_id = 8dbcdfbe-3956-4b95-b94c-5241091a5b61 response_code = 204 uri = /switch-ports
16972024-11-09T01:23:09.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54881
16982024-11-09T01:23:09.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54881 req_id = db6b7e47-4670-4120-8170-9740cf80de57 response_code = 200 uri = /vpc-routes
16992024-11-09T01:23:09.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57396 req_id = 617e0508-de9f-46af-b564-d4ed6dd28e3d response_code = 200 uri = /network-bootstore-config
17002024-11-09T01:23:09.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2549 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54482 req_id = 6520be9b-a181-42e7-977e-8400e24f9a5c response_code = 204 uri = /vpc-routes
17012024-11-09T01:23:10.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42702
17022024-11-09T01:23:10.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42702 req_id = c5b11359-e866-4a5f-ba22-77007c746d5c response_code = 200 uri = /vpc-routes
17032024-11-09T01:23:10.003ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
17042024-11-09T01:23:10.003ZINFOSledAgent (bootstore): Writing ledger to /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
17052024-11-09T01:23:10.004ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
17062024-11-09T01:23:10.005ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
17072024-11-09T01:23:10.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3499 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57396 req_id = 9f7d3199-e318-4a22-a1e5-cea0d5e36d0f response_code = 204 uri = /network-bootstore-config
17082024-11-09T01:23:10.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55194
17092024-11-09T01:23:10.033ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17102024-11-09T01:23:10.082ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17112024-11-09T01:23:10.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 120970 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55194 req_id = a6e855f8-021f-4cdf-b1f8-56b94c7fbbca response_code = 204 uri = /switch-ports
17122024-11-09T01:23:10.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53100
17132024-11-09T01:23:10.154ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
17142024-11-09T01:23:10.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54881 req_id = 11d8dfbe-f327-45ec-a75c-34336d21bf62 response_code = 204 uri = /eip-gateways
17152024-11-09T01:23:10.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53100 req_id = 94b6364c-3db3-4a2e-9df8-494476c3067c response_code = 200 uri = /v2p
17162024-11-09T01:23:10.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 326 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55194 req_id = fd30ff35-4d71-4668-b776-66a774179ced response_code = 200 uri = /network-bootstore-config
17172024-11-09T01:23:10.198ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
17182024-11-09T01:23:10.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42702 req_id = 80727a4a-c343-4dce-9e7f-c694b86a25c8 response_code = 204 uri = /eip-gateways
17192024-11-09T01:23:10.279ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38292
17202024-11-09T01:23:10.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38292 req_id = e38d2022-5a40-434b-9774-3f0db6c31113 response_code = 200 uri = /v2p
17212024-11-09T01:23:10.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42702 req_id = 41837f0b-aea4-4f5e-8c0b-d03c22363fe6 response_code = 204 uri = /vpc-routes
17222024-11-09T01:23:10.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42602
17232024-11-09T01:23:10.344ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17242024-11-09T01:23:10.384ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17252024-11-09T01:23:10.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99556 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42602 req_id = 7ceddca3-f38b-488e-bcc7-911580779c66 response_code = 204 uri = /switch-ports
17262024-11-09T01:23:10.444ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
17272024-11-09T01:23:10.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 510 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54881 req_id = 87fe68cf-5905-4a2d-ae6f-36009b4217ae response_code = 204 uri = /vpc-routes
17282024-11-09T01:23:10.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42602 req_id = 8233db9e-446d-4f97-b44b-9a1b3440ee1a response_code = 200 uri = /network-bootstore-config
17292024-11-09T01:23:12.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38443
17302024-11-09T01:23:12.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38443 req_id = 4a3ab155-28d6-461a-8d3d-9ef23dcef899 response_code = 200 uri = /vpc-routes
17312024-11-09T01:23:12.527ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
17322024-11-09T01:23:12.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38443 req_id = 9503c223-d4b7-4985-bf4b-bbb3d7b46dad response_code = 204 uri = /eip-gateways
17332024-11-09T01:23:12.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38443 req_id = 1731aefe-4860-4907-9c9c-4c04da56b965 response_code = 204 uri = /vpc-routes
17342024-11-09T01:23:20.394ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42499
17352024-11-09T01:23:20.394ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42499 req_id = 99833868-7714-4921-a660-bbfd6ea312bb response_code = 200 uri = /baseboard
17362024-11-09T01:23:39.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49693
17372024-11-09T01:23:39.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49693 req_id = f75b9ae1-7d09-45ca-82fe-35e7397f9d04 response_code = 200 uri = /vpc-routes
17382024-11-09T01:23:39.449ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
17392024-11-09T01:23:39.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49693 req_id = 3ff4486a-0089-4083-847a-7cdf650b048e response_code = 204 uri = /eip-gateways
17402024-11-09T01:23:39.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46324
17412024-11-09T01:23:39.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46324 req_id = 9af7a6ef-2c51-44c5-b2c8-17f79b294b15 response_code = 200 uri = /v2p
17422024-11-09T01:23:39.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49693 req_id = 85d2a47b-7b70-4701-aeb6-e74c227da87c response_code = 204 uri = /vpc-routes
17432024-11-09T01:23:39.684ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52280
17442024-11-09T01:23:39.685ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17452024-11-09T01:23:39.723ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17462024-11-09T01:23:39.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99648 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52280 req_id = d051b716-5a73-4485-94c9-bc3cdcd419f9 response_code = 204 uri = /switch-ports
17472024-11-09T01:23:39.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52280 req_id = d3d91d31-d5b8-4fcf-8620-94b717d1a8fe response_code = 200 uri = /network-bootstore-config
17482024-11-09T01:23:39.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60623
17492024-11-09T01:23:39.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60623 req_id = 7fc442af-c7ea-4671-8534-08ee992ef5e2 response_code = 200 uri = /vpc-routes
17502024-11-09T01:23:39.911ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
17512024-11-09T01:23:39.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60623 req_id = 84fd000a-5752-42c3-b8b7-690f31512d13 response_code = 204 uri = /eip-gateways
17522024-11-09T01:23:39.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49020
17532024-11-09T01:23:39.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49020 req_id = 6530d099-2824-4599-99ad-df4ebbe2ea2a response_code = 200 uri = /v2p
17542024-11-09T01:23:40.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60623 req_id = 6419e9d5-c732-4706-b2f1-a5429d597829 response_code = 204 uri = /vpc-routes
17552024-11-09T01:23:40.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43806
17562024-11-09T01:23:40.196ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17572024-11-09T01:23:40.238ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17582024-11-09T01:23:40.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95012 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43806 req_id = d3365381-0fb3-4b22-a688-6d6e1c2643eb response_code = 204 uri = /switch-ports
17592024-11-09T01:23:40.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62553
17602024-11-09T01:23:40.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61809
17612024-11-09T01:23:40.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43806 req_id = 780c4aa6-f563-483c-8cfb-26775dfd8ab5 response_code = 200 uri = /network-bootstore-config
17622024-11-09T01:23:40.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62553 req_id = 1ad26fbf-6683-4912-b72d-28333b4d3537 response_code = 200 uri = /vpc-routes
17632024-11-09T01:23:40.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61809 req_id = 01584aea-86d8-4338-bad0-0feca33922f9 response_code = 200 uri = /v2p
17642024-11-09T01:23:40.349ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
17652024-11-09T01:23:40.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62553 req_id = 65abf31e-7ee8-4e73-9703-22cd90edfe3a response_code = 204 uri = /eip-gateways
17662024-11-09T01:23:40.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62553 req_id = f63cacba-bd82-44e8-aa7c-0be8de30e46e response_code = 204 uri = /vpc-routes
17672024-11-09T01:23:40.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37574
17682024-11-09T01:23:40.393ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17692024-11-09T01:23:40.430ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17702024-11-09T01:23:40.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89813 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37574 req_id = 949189ea-2181-426a-92a5-7f2eb4d4b292 response_code = 204 uri = /switch-ports
17712024-11-09T01:23:40.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37574 req_id = 8b2f8a50-d14b-4f67-9bbe-1fc48eb6769b response_code = 200 uri = /network-bootstore-config
17722024-11-09T01:23:50.429ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52922
17732024-11-09T01:23:50.429ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52922 req_id = e6a09a16-f4b6-469b-90dc-e8bd0ed1c3be response_code = 200 uri = /baseboard
17742024-11-09T01:24:09.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56967
17752024-11-09T01:24:09.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56967 req_id = 9701cb09-a13a-4d17-8fd2-ddd8cdcc94ac response_code = 200 uri = /vpc-routes
17762024-11-09T01:24:09.211ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
17772024-11-09T01:24:09.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56967 req_id = 28207ff1-67f8-4431-a649-3458e9e78288 response_code = 204 uri = /eip-gateways
17782024-11-09T01:24:09.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56967 req_id = 1c494d70-ad1f-409f-9e09-cf59ab3f2520 response_code = 204 uri = /vpc-routes
17792024-11-09T01:24:09.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56948
17802024-11-09T01:24:09.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56948 req_id = 2841a771-59b3-40ab-b1f4-ea34ba5850ed response_code = 200 uri = /v2p
17812024-11-09T01:24:09.488ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38531
17822024-11-09T01:24:09.488ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17832024-11-09T01:24:09.530ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17842024-11-09T01:24:09.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117948 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38531 req_id = 8c7b7d8b-91fd-4298-8a79-8552837bec10 response_code = 204 uri = /switch-ports
17852024-11-09T01:24:09.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38531 req_id = 81e1fcf9-b66d-42cf-9c7e-ac4d926237d6 response_code = 200 uri = /network-bootstore-config
17862024-11-09T01:24:09.712ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37256
17872024-11-09T01:24:09.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37256 req_id = d939cac7-024f-433a-89c3-1bad65f9731c response_code = 200 uri = /vpc-routes
17882024-11-09T01:24:09.726ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
17892024-11-09T01:24:09.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37256 req_id = 76e67b00-b151-4597-8ea2-58ef6b480cd0 response_code = 204 uri = /eip-gateways
17902024-11-09T01:24:09.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56046
17912024-11-09T01:24:09.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56046 req_id = c5e9d6c6-d623-463f-b9e1-6f008444b8be response_code = 200 uri = /v2p
17922024-11-09T01:24:09.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37256 req_id = 91090d82-5586-44eb-bd36-0d21f4955052 response_code = 204 uri = /vpc-routes
17932024-11-09T01:24:10.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62773
17942024-11-09T01:24:10.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62773 req_id = 3890ad86-2fbf-4ea4-a66e-f4cba8efcf8e response_code = 200 uri = /vpc-routes
17952024-11-09T01:24:10.053ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
17962024-11-09T01:24:10.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62773 req_id = 09602b26-59c6-4fc9-b836-c9c214a875a4 response_code = 204 uri = /eip-gateways
17972024-11-09T01:24:10.061ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39527
17982024-11-09T01:24:10.062ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17992024-11-09T01:24:10.095ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18002024-11-09T01:24:10.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85085 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39527 req_id = c1eaea21-0ba4-47ea-b907-9c28e0c67975 response_code = 204 uri = /switch-ports
18012024-11-09T01:24:10.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44863
18022024-11-09T01:24:10.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39527 req_id = 1a06bcb2-b56c-4932-b101-4e1d6302d130 response_code = 200 uri = /network-bootstore-config
18032024-11-09T01:24:10.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44863 req_id = cbd6be08-0032-454e-b929-38001bc24637 response_code = 200 uri = /v2p
18042024-11-09T01:24:10.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 351 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62773 req_id = 78ef5a7e-fd17-4da6-992d-ca69a0671ab4 response_code = 204 uri = /vpc-routes
18052024-11-09T01:24:10.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57211
18062024-11-09T01:24:10.265ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18072024-11-09T01:24:10.301ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18082024-11-09T01:24:10.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88795 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57211 req_id = acb263cd-4da6-42ba-90d3-d6212adab524 response_code = 204 uri = /switch-ports
18092024-11-09T01:24:10.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57211 req_id = ab0f8665-3dd9-4edc-a684-9ba3456e3a1d response_code = 200 uri = /network-bootstore-config
18102024-11-09T01:24:20.480ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48797
18112024-11-09T01:24:20.480ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48797 req_id = a1ccde38-7a46-41b4-905a-8aebe25e9d94 response_code = 200 uri = /baseboard
18122024-11-09T01:24:39.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45149
18132024-11-09T01:24:39.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45149 req_id = dd53ab3b-6053-44bc-82c5-6ab69aed7524 response_code = 200 uri = /vpc-routes
18142024-11-09T01:24:39.452ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
18152024-11-09T01:24:39.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45149 req_id = fba65c04-f85a-4145-b92f-ea1260a68771 response_code = 204 uri = /eip-gateways
18162024-11-09T01:24:39.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45149 req_id = 7b6da90a-9c8a-4899-bf4a-93764414f55d response_code = 204 uri = /vpc-routes
18172024-11-09T01:24:39.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61360
18182024-11-09T01:24:39.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61360 req_id = 9f8660c2-bf6b-418a-8db2-29de51352468 response_code = 200 uri = /v2p
18192024-11-09T01:24:39.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35867
18202024-11-09T01:24:39.636ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18212024-11-09T01:24:39.675ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18222024-11-09T01:24:39.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105642 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35867 req_id = 33b2d8e7-f7e7-4b7a-af5b-187461c43c05 response_code = 204 uri = /switch-ports
18232024-11-09T01:24:39.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35867 req_id = 24ceeae3-c0cf-4c4f-9d52-a15b0700bd52 response_code = 200 uri = /network-bootstore-config
18242024-11-09T01:24:39.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47843
18252024-11-09T01:24:39.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47843 req_id = 5133d300-b080-4818-8bac-bf4426ed7c68 response_code = 200 uri = /vpc-routes
18262024-11-09T01:24:39.890ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
18272024-11-09T01:24:39.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47843 req_id = dab94c43-41a1-4c8a-86b4-30619da96972 response_code = 204 uri = /eip-gateways
18282024-11-09T01:24:39.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47843 req_id = 8229bafb-5364-429d-b2f4-94b23ac974b9 response_code = 204 uri = /vpc-routes
18292024-11-09T01:24:40.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63008
18302024-11-09T01:24:40.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63008 req_id = aebee0bd-b56e-4b40-a5f2-3674c02f5786 response_code = 200 uri = /vpc-routes
18312024-11-09T01:24:40.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48436
18322024-11-09T01:24:40.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48436 req_id = 85fc5b5e-a72f-4a33-a017-27b718b1f955 response_code = 200 uri = /v2p
18332024-11-09T01:24:40.145ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
18342024-11-09T01:24:40.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63008 req_id = 3a296450-1a3e-4d19-acff-fb820e214578 response_code = 204 uri = /eip-gateways
18352024-11-09T01:24:40.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50656
18362024-11-09T01:24:40.147ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18372024-11-09T01:24:40.186ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18382024-11-09T01:24:40.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91164 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50656 req_id = 5e334d93-d5f5-446e-9fca-fcf6a6d1c5fe response_code = 204 uri = /switch-ports
18392024-11-09T01:24:40.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63008 req_id = 129c4351-a84f-4f34-9b7a-42227ed3cfa0 response_code = 204 uri = /vpc-routes
18402024-11-09T01:24:40.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50656 req_id = 5f5c364b-3264-49f0-85aa-f6557e4c79b8 response_code = 200 uri = /network-bootstore-config
18412024-11-09T01:24:40.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41953
18422024-11-09T01:24:40.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41953 req_id = 03fe6831-314f-4bbf-a7ec-aa91814c25b5 response_code = 200 uri = /v2p
18432024-11-09T01:24:40.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43230
18442024-11-09T01:24:40.386ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18452024-11-09T01:24:40.425ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18462024-11-09T01:24:40.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94950 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43230 req_id = 91abfc7b-8c05-4f1b-8931-bba4113c6c08 response_code = 204 uri = /switch-ports
18472024-11-09T01:24:40.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43230 req_id = 22a11dc7-39aa-4f34-9e5a-2796b395e767 response_code = 200 uri = /network-bootstore-config
18482024-11-09T01:24:50.515ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60798
18492024-11-09T01:24:50.515ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60798 req_id = 4848e0b7-fa90-417f-a1f6-34ac895e22b7 response_code = 200 uri = /baseboard
18502024-11-09T01:25:09.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49384
18512024-11-09T01:25:09.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49384 req_id = 3917e5b7-c57a-49c0-abba-f13d033eda6e response_code = 200 uri = /vpc-routes
18522024-11-09T01:25:09.246ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
18532024-11-09T01:25:09.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49384 req_id = 288d4728-563a-4565-b86d-96220e657660 response_code = 204 uri = /eip-gateways
18542024-11-09T01:25:09.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49384 req_id = f028c8b4-9533-40b3-ad16-ad2a3753a6eb response_code = 204 uri = /vpc-routes
18552024-11-09T01:25:09.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42130
18562024-11-09T01:25:09.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42130 req_id = 9a30321a-1fc8-483d-a35c-f34a4e97abd2 response_code = 200 uri = /v2p
18572024-11-09T01:25:09.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43598
18582024-11-09T01:25:09.501ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18592024-11-09T01:25:09.546ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18602024-11-09T01:25:09.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 119527 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43598 req_id = bde5ff1f-e5ec-4700-b049-59de3eaca2cc response_code = 204 uri = /switch-ports
18612024-11-09T01:25:09.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43598 req_id = 160f76e6-9580-4c17-b75d-fd1833361c50 response_code = 200 uri = /network-bootstore-config
18622024-11-09T01:25:09.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55296
18632024-11-09T01:25:09.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55296 req_id = 10d04ea5-7c2c-4c37-ae71-c78f8894e0c6 response_code = 200 uri = /vpc-routes
18642024-11-09T01:25:09.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50814
18652024-11-09T01:25:09.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50814 req_id = cf9f0873-e1c3-4e08-a379-6f934500a42d response_code = 200 uri = /v2p
18662024-11-09T01:25:09.896ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49056
18672024-11-09T01:25:09.896ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18682024-11-09T01:25:09.936ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18692024-11-09T01:25:09.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95457 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49056 req_id = 25341972-fc9c-4870-b6c0-a7ebc5c2f4a1 response_code = 204 uri = /switch-ports
18702024-11-09T01:25:09.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48753
18712024-11-09T01:25:09.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48753 req_id = 88499e0d-7e38-40df-8ebb-e15536ce70cc response_code = 200 uri = /vpc-routes
18722024-11-09T01:25:09.992ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
18732024-11-09T01:25:09.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55296 req_id = 96420ea4-7dea-4782-8860-0e7a38650ad9 response_code = 204 uri = /eip-gateways
18742024-11-09T01:25:09.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49056 req_id = d5dfd3f3-0372-481b-8a7d-b131e1617aa1 response_code = 200 uri = /network-bootstore-config
18752024-11-09T01:25:10.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55296 req_id = 74b046fb-aa10-4711-8193-bc359eea8209 response_code = 204 uri = /vpc-routes
18762024-11-09T01:25:10.093ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55087
18772024-11-09T01:25:10.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55087 req_id = 0e971c16-39d6-483e-a7e5-6f8a2b7814f9 response_code = 200 uri = /v2p
18782024-11-09T01:25:10.141ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
18792024-11-09T01:25:10.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48753 req_id = 262dbb83-91e7-4e24-9480-402c64d2af14 response_code = 204 uri = /eip-gateways
18802024-11-09T01:25:10.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48753 req_id = 4b7d94d5-3531-46b7-af55-d7ec77b434be response_code = 204 uri = /vpc-routes
18812024-11-09T01:25:10.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64253
18822024-11-09T01:25:10.251ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18832024-11-09T01:25:10.288ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18842024-11-09T01:25:10.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90491 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64253 req_id = 655a1e51-369a-4bff-aa4f-dda8b5bbb252 response_code = 204 uri = /switch-ports
18852024-11-09T01:25:10.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64253 req_id = 2d39ae07-7851-4619-bebe-2ef26d3b0ea5 response_code = 200 uri = /network-bootstore-config
18862024-11-09T01:25:20.548ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55283
18872024-11-09T01:25:20.548ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55283 req_id = 775a7e70-f490-4ef0-872b-dba97a2df0dd response_code = 200 uri = /baseboard
18882024-11-09T01:25:30.136ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
18892024-11-09T01:25:39.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46032
18902024-11-09T01:25:39.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46032 req_id = 537fdd86-0ad4-4580-bac9-38a6ada01c4b response_code = 200 uri = /vpc-routes
18912024-11-09T01:25:39.594ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
18922024-11-09T01:25:39.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46032 req_id = f43efe83-b775-4c70-aacc-1f32dc075669 response_code = 204 uri = /eip-gateways
18932024-11-09T01:25:39.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55509
18942024-11-09T01:25:39.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55509 req_id = 9c622748-c136-4514-9f53-7a57a6cd6f3a response_code = 200 uri = /v2p
18952024-11-09T01:25:39.811ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37808
18962024-11-09T01:25:39.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37808 req_id = 67100472-d0a5-4f88-a993-ddb4d3ee9279 response_code = 200 uri = /vpc-routes
18972024-11-09T01:25:39.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46032 req_id = 92107c51-5d9f-4887-b7ee-10bef78cb554 response_code = 204 uri = /vpc-routes
18982024-11-09T01:25:39.881ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
18992024-11-09T01:25:39.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37808 req_id = e32c509c-c3d8-4d1f-8fc1-e1651d3413cb response_code = 204 uri = /eip-gateways
19002024-11-09T01:25:39.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37808 req_id = 795c61c0-d605-4c07-bdaa-015547bfb030 response_code = 204 uri = /vpc-routes
19012024-11-09T01:25:39.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42086
19022024-11-09T01:25:39.897ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19032024-11-09T01:25:39.939ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19042024-11-09T01:25:40.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103432 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42086 req_id = 6dba7e9e-a69b-47dc-a726-c66c0e8dd406 response_code = 204 uri = /switch-ports
19052024-11-09T01:25:40.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37971
19062024-11-09T01:25:40.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37971 req_id = a1cf792c-8101-4d1c-8e7b-f71df66423d2 response_code = 200 uri = /v2p
19072024-11-09T01:25:40.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42086 req_id = d00d67e6-fff1-47b8-96cd-59a4e480ea54 response_code = 200 uri = /network-bootstore-config
19082024-11-09T01:25:40.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56395
19092024-11-09T01:25:40.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56395 req_id = 4a82eff6-41f9-4e77-ad03-8a875596751e response_code = 200 uri = /vpc-routes
19102024-11-09T01:25:40.101ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
19112024-11-09T01:25:40.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56395 req_id = 1537df58-938b-4353-bcb2-5c7666680207 response_code = 204 uri = /eip-gateways
19122024-11-09T01:25:40.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56395 req_id = b470d4b8-c8aa-4aab-8314-17306c7dec73 response_code = 204 uri = /vpc-routes
19132024-11-09T01:25:40.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56478
19142024-11-09T01:25:40.217ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19152024-11-09T01:25:40.255ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19162024-11-09T01:25:40.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93477 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56478 req_id = 10768da7-ff5c-468c-902f-6a0fc3d63fe8 response_code = 204 uri = /switch-ports
19172024-11-09T01:25:40.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47213
19182024-11-09T01:25:40.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47213 req_id = 0988f305-d94b-420b-89bd-2c183b90f405 response_code = 200 uri = /v2p
19192024-11-09T01:25:40.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56478 req_id = 626e59dc-a96a-40ac-95d2-2e765a5f885a response_code = 200 uri = /network-bootstore-config
19202024-11-09T01:25:40.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40077
19212024-11-09T01:25:40.321ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19222024-11-09T01:25:40.358ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19232024-11-09T01:25:40.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92732 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40077 req_id = 546945c6-9408-44bf-9067-b41abf14e469 response_code = 204 uri = /switch-ports
19242024-11-09T01:25:40.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40077 req_id = 57ae62d4-c3bf-46c3-930f-861634592b78 response_code = 200 uri = /network-bootstore-config
19252024-11-09T01:25:50.584ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64927
19262024-11-09T01:25:50.584ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64927 req_id = 2c2e9acb-5697-4481-ad10-13c4daf6d8a8 response_code = 200 uri = /baseboard
19272024-11-09T01:26:09.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44396
19282024-11-09T01:26:09.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44396 req_id = 2d273991-428e-4cb6-ac2e-c504a30e80ba response_code = 200 uri = /vpc-routes
19292024-11-09T01:26:09.458ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
19302024-11-09T01:26:09.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44396 req_id = 923cdade-2941-4865-961e-5e39ef8bf7da response_code = 204 uri = /eip-gateways
19312024-11-09T01:26:09.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54092
19322024-11-09T01:26:09.537ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19332024-11-09T01:26:09.583ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19342024-11-09T01:26:09.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115689 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54092 req_id = 19cec56b-3688-49a3-b3c8-283b885d5c13 response_code = 204 uri = /switch-ports
19352024-11-09T01:26:09.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35520
19362024-11-09T01:26:09.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35520 req_id = a7e0e771-aff1-4c28-a9da-ea9126c372aa response_code = 200 uri = /v2p
19372024-11-09T01:26:09.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54092 req_id = 55df9ef0-3467-4b84-85d2-afb3d00b2bbf response_code = 200 uri = /network-bootstore-config
19382024-11-09T01:26:09.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44396 req_id = d2fc9e25-66ed-4502-9b85-927c0d65febf response_code = 204 uri = /vpc-routes
19392024-11-09T01:26:09.709ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34245
19402024-11-09T01:26:09.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34245 req_id = e2f80541-190e-46a8-9081-77a4776e73f4 response_code = 200 uri = /vpc-routes
19412024-11-09T01:26:09.754ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
19422024-11-09T01:26:09.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34245 req_id = 1210c575-de6e-4ff3-8bbd-c04320e2e782 response_code = 204 uri = /eip-gateways
19432024-11-09T01:26:09.801ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58821
19442024-11-09T01:26:09.801ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19452024-11-09T01:26:09.854ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19462024-11-09T01:26:09.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116469 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58821 req_id = 41772f75-f2ea-4d50-afe1-9c8f1602966e response_code = 204 uri = /switch-ports
19472024-11-09T01:26:09.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33566
19482024-11-09T01:26:09.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33566 req_id = 5a5938ea-d461-4c1a-9cd4-d412e2f6bf38 response_code = 200 uri = /v2p
19492024-11-09T01:26:09.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58821 req_id = c78af3ce-7ffb-45a1-8077-c8adbf4f57bb response_code = 200 uri = /network-bootstore-config
19502024-11-09T01:26:09.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 392 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34245 req_id = a993cc6d-2185-4cfa-91fd-d3a36c56ebcb response_code = 204 uri = /vpc-routes
19512024-11-09T01:26:09.934ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57032
19522024-11-09T01:26:09.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57032 req_id = ad4233d9-841f-4a3a-927f-e4e6aaba99c8 response_code = 200 uri = /vpc-routes
19532024-11-09T01:26:09.979ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
19542024-11-09T01:26:09.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57032 req_id = 16163293-ea75-4c01-a85a-1937a7b00556 response_code = 204 uri = /eip-gateways
19552024-11-09T01:26:09.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57032 req_id = 3d9abb66-9e21-4d70-973d-f91ea93513f6 response_code = 204 uri = /vpc-routes
19562024-11-09T01:26:10.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33249
19572024-11-09T01:26:10.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33249 req_id = 3632b9c9-9586-4fc2-af63-ddd34a210461 response_code = 200 uri = /v2p
19582024-11-09T01:26:10.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34776
19592024-11-09T01:26:10.072ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19602024-11-09T01:26:10.111ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19612024-11-09T01:26:10.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96602 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34776 req_id = a60b6668-ddb7-494b-8f8d-3f72b3df60b1 response_code = 204 uri = /switch-ports
19622024-11-09T01:26:10.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34776 req_id = fb3e2b8d-2510-4c7a-b3f6-1fe7720d7e56 response_code = 200 uri = /network-bootstore-config
19632024-11-09T01:26:20.617ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56247
19642024-11-09T01:26:20.617ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56247 req_id = 870c63f5-a546-4a66-abde-c44147c0c3ef response_code = 200 uri = /baseboard
19652024-11-09T01:26:39.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56177
19662024-11-09T01:26:39.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 677 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56177 req_id = 5bc6bb96-52c6-4d8c-9179-b59fab519df7 response_code = 200 uri = /vpc-routes
19672024-11-09T01:26:39.394ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
19682024-11-09T01:26:39.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56177 req_id = 44c44493-5db0-4280-8874-e960448e69a5 response_code = 204 uri = /eip-gateways
19692024-11-09T01:26:39.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56177 req_id = 4885298a-6e88-4182-ad9f-3e2009f7ac77 response_code = 204 uri = /vpc-routes
19702024-11-09T01:26:39.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42275
19712024-11-09T01:26:39.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42275 req_id = d24eb6ed-3f84-4a9a-b916-0d41f0347598 response_code = 200 uri = /v2p
19722024-11-09T01:26:39.771ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65383
19732024-11-09T01:26:39.771ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19742024-11-09T01:26:39.825ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19752024-11-09T01:26:39.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138357 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65383 req_id = 955148b2-9059-401c-8b98-c4561a1ec4e9 response_code = 204 uri = /switch-ports
19762024-11-09T01:26:39.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62161
19772024-11-09T01:26:39.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62161 req_id = 35fb299f-3bb6-4037-91b4-1af993f5a4a5 response_code = 200 uri = /vpc-routes
19782024-11-09T01:26:39.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65383 req_id = 4bc5fe73-2cf0-4092-a906-2929cfd8d91e response_code = 200 uri = /network-bootstore-config
19792024-11-09T01:26:39.962ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
19802024-11-09T01:26:39.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62161 req_id = 527adec1-1e1e-4adf-9548-4108b4002fe1 response_code = 204 uri = /eip-gateways
19812024-11-09T01:26:39.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35497
19822024-11-09T01:26:39.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35497 req_id = a6894b4f-ac57-416c-a2e9-d5fbc2f6731d response_code = 200 uri = /v2p
19832024-11-09T01:26:39.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62161 req_id = 0dde8844-2ffc-466b-9fec-989c3b0c3c7b response_code = 204 uri = /vpc-routes
19842024-11-09T01:26:40.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57355
19852024-11-09T01:26:40.041ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19862024-11-09T01:26:40.080ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19872024-11-09T01:26:40.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96273 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57355 req_id = 285ed168-8dc1-44c6-bbdf-5ea006beb348 response_code = 204 uri = /switch-ports
19882024-11-09T01:26:40.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57355 req_id = 6db8f74e-e2c4-464e-851b-fab35de17eac response_code = 200 uri = /network-bootstore-config
19892024-11-09T01:26:40.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53676
19902024-11-09T01:26:40.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53676 req_id = 1e19ecff-7b8e-4df7-9a5d-b4d067b62d55 response_code = 200 uri = /v2p
19912024-11-09T01:26:40.242ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39556
19922024-11-09T01:26:40.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39556 req_id = 0b824b15-7da3-448e-8aad-9ab7ed4a1fb7 response_code = 200 uri = /vpc-routes
19932024-11-09T01:26:40.256ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
19942024-11-09T01:26:40.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39556 req_id = e37f9cc4-243c-41bf-83db-8cde467a1be6 response_code = 204 uri = /eip-gateways
19952024-11-09T01:26:40.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39556 req_id = f29edbc2-ec42-4bd1-8a9c-22273755dc90 response_code = 204 uri = /vpc-routes
19962024-11-09T01:26:40.317ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37682
19972024-11-09T01:26:40.317ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19982024-11-09T01:26:40.357ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19992024-11-09T01:26:40.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96592 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37682 req_id = 77a8f309-0550-4bf8-8fde-e9057862aab6 response_code = 204 uri = /switch-ports
20002024-11-09T01:26:40.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37682 req_id = 0087d72d-d45c-4854-843e-3f6adb111c34 response_code = 200 uri = /network-bootstore-config
20012024-11-09T01:26:50.650ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57902
20022024-11-09T01:26:50.651ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57902 req_id = f776e24c-5770-437b-9e88-aedfcc00fff4 response_code = 200 uri = /baseboard
20032024-11-09T01:27:09.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62854
20042024-11-09T01:27:09.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62854 req_id = af95df70-817b-449b-afd5-b6ddebf296bd response_code = 200 uri = /v2p
20052024-11-09T01:27:09.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38386
20062024-11-09T01:27:09.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38386 req_id = c3456136-59fe-4512-9b7b-6253cb218948 response_code = 200 uri = /vpc-routes
20072024-11-09T01:27:09.351ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
20082024-11-09T01:27:09.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38386 req_id = 214cae23-f6fe-42d3-8a59-c4837c87806e response_code = 204 uri = /eip-gateways
20092024-11-09T01:27:09.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38386 req_id = 4dd75512-838d-47b2-876f-1356587fb94b response_code = 204 uri = /vpc-routes
20102024-11-09T01:27:09.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40894
20112024-11-09T01:27:09.420ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20122024-11-09T01:27:09.459ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20132024-11-09T01:27:09.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93980 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40894 req_id = 601f9a61-1726-47b7-bf40-514f61ef08f8 response_code = 204 uri = /switch-ports
20142024-11-09T01:27:09.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40894 req_id = efd8e028-bfcb-4092-b65d-2b876437047e response_code = 200 uri = /network-bootstore-config
20152024-11-09T01:27:09.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55236
20162024-11-09T01:27:09.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55236 req_id = e8e54f1d-73f9-42b0-9497-8b1df0bb9204 response_code = 200 uri = /vpc-routes
20172024-11-09T01:27:09.647ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
20182024-11-09T01:27:09.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55236 req_id = 66cb8430-a35a-466e-9e9e-8499777cc6fa response_code = 204 uri = /eip-gateways
20192024-11-09T01:27:09.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55236 req_id = 57450ebd-68ef-4335-87e4-cac48581c300 response_code = 204 uri = /vpc-routes
20202024-11-09T01:27:09.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32779
20212024-11-09T01:27:09.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32779 req_id = 0ae3ac87-0d8e-448a-beef-f35fa57e8ce0 response_code = 200 uri = /v2p
20222024-11-09T01:27:09.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50902
20232024-11-09T01:27:09.844ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20242024-11-09T01:27:09.881ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20252024-11-09T01:27:09.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93764 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50902 req_id = 99ac70f2-707e-4af1-b7a5-5f654c08f001 response_code = 204 uri = /switch-ports
20262024-11-09T01:27:09.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50902 req_id = 72d82f54-b520-408b-841a-7b812443a7dc response_code = 200 uri = /network-bootstore-config
20272024-11-09T01:27:09.997ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44375
20282024-11-09T01:27:09.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44375 req_id = 46d17500-ee00-4c13-9044-a7923ea7cb02 response_code = 200 uri = /vpc-routes
20292024-11-09T01:27:10.012ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
20302024-11-09T01:27:10.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44375 req_id = b4f5fcbd-600a-496e-a958-89fdb862df8e response_code = 204 uri = /eip-gateways
20312024-11-09T01:27:10.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44375 req_id = 6dd12f82-90ec-4972-8a49-41e8d16fb711 response_code = 204 uri = /vpc-routes
20322024-11-09T01:27:10.027ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34612
20332024-11-09T01:27:10.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34612 req_id = fc1c3d64-2e7e-41b3-8263-8e9232765dd1 response_code = 200 uri = /v2p
20342024-11-09T01:27:10.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65150
20352024-11-09T01:27:10.133ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20362024-11-09T01:27:10.174ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20372024-11-09T01:27:10.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98125 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65150 req_id = 9a647971-6ab3-4151-be93-e4584b878060 response_code = 204 uri = /switch-ports
20382024-11-09T01:27:10.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65150 req_id = 059bfa35-43ff-4595-8233-40ee597e4602 response_code = 200 uri = /network-bootstore-config
20392024-11-09T01:27:20.683ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55865
20402024-11-09T01:27:20.684ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55865 req_id = a5ca6d44-8811-469c-81a4-875012c255df response_code = 200 uri = /baseboard
20412024-11-09T01:27:39.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46344
20422024-11-09T01:27:39.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46344 req_id = d79c044e-a3f3-4537-90ad-4c1f36d4618c response_code = 200 uri = /vpc-routes
20432024-11-09T01:27:39.342ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
20442024-11-09T01:27:39.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46344 req_id = 159b1f63-1442-45fd-a52a-3393c1f7a6ce response_code = 204 uri = /eip-gateways
20452024-11-09T01:27:39.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46344 req_id = fa94b3df-6260-43fa-b748-0bfcc004f9ec response_code = 204 uri = /vpc-routes
20462024-11-09T01:27:39.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38016
20472024-11-09T01:27:39.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38016 req_id = ea8c1b75-500d-4126-90f4-4091608db302 response_code = 200 uri = /v2p
20482024-11-09T01:27:39.590ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64431
20492024-11-09T01:27:39.590ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20502024-11-09T01:27:39.642ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20512024-11-09T01:27:39.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 120037 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64431 req_id = 0a1b5945-0b20-4218-892e-f906de217d52 response_code = 204 uri = /switch-ports
20522024-11-09T01:27:39.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64431 req_id = ac2a9cd6-cad2-453c-9e2a-56713e52e621 response_code = 200 uri = /network-bootstore-config
20532024-11-09T01:27:39.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55768
20542024-11-09T01:27:39.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55768 req_id = a64c6ba8-4739-4a28-a7dc-4508216d53a7 response_code = 200 uri = /vpc-routes
20552024-11-09T01:27:39.844ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
20562024-11-09T01:27:39.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55768 req_id = ee55c3b0-0eae-4e27-98ec-592e92717a75 response_code = 204 uri = /eip-gateways
20572024-11-09T01:27:39.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65255
20582024-11-09T01:27:39.872ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 49d235c5-d54d-4258-a645-9d181875557a, kind: Service { id: 34219892-cef8-4169-a366-ce17844120f6 }, name: Name("external-dns-34219892-cef8-4169-a366-ce17844120f6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce088bfb-77e0-4498-b680-d4fab72b0123, kind: Service { id: 530f76d0-bec9-4ae0-beb0-d217f68ae05a }, name: Name("external-dns-530f76d0-bec9-4ae0-beb0-d217f68ae05a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 314cfeab-323e-4445-9502-7e16efd0a788, kind: Service { id: 86b379c9-5608-41ec-a3b2-837d116869db }, name: Name("nexus-86b379c9-5608-41ec-a3b2-837d116869db"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9fa251a1-2d97-4513-b670-a39f36efe9c9, kind: Service { id: 02562f58-d954-43f9-93a1-2ae8426ccbe9 }, name: Name("nexus-02562f58-d954-43f9-93a1-2ae8426ccbe9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b1ef6e1e-4501-48bd-9de3-1d5889b6ea55, kind: Service { id: d59d4e08-d131-4d11-8244-662923dd9357 }, name: Name("nexus-d59d4e08-d131-4d11-8244-662923dd9357"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 166])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20592024-11-09T01:27:39.872ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20602024-11-09T01:27:39.872ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20612024-11-09T01:27:39.872ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
20622024-11-09T01:27:39.872ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20632024-11-09T01:27:39.873ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20642024-11-09T01:27:39.873ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20652024-11-09T01:27:39.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 488 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65255 req_id = e96bad82-61d0-4ae7-b9b7-bec9f8b9ae18 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20662024-11-09T01:27:39.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56602
20672024-11-09T01:27:39.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56602 req_id = 46b5c457-5903-43fb-9e6d-ca73af77e711 response_code = 200 uri = /v2p
20682024-11-09T01:27:39.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55768 req_id = 9c074023-93fc-4624-b404-3f2daf77d111 response_code = 204 uri = /vpc-routes
20692024-11-09T01:27:39.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38424
20702024-11-09T01:27:39.969ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20712024-11-09T01:27:40.009ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20722024-11-09T01:27:40.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99572 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38424 req_id = 73dab696-87f7-4cf5-9db3-15e7c0f7e610 response_code = 204 uri = /switch-ports
20732024-11-09T01:27:40.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38424 req_id = df59eab8-b804-4fad-ba4c-d35b31b1eeb8 response_code = 200 uri = /network-bootstore-config
20742024-11-09T01:27:40.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43295
20752024-11-09T01:27:40.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43295 req_id = 9a2c342d-eef2-49e0-8d04-8441e8a5d265 response_code = 200 uri = /v2p
20762024-11-09T01:27:40.229ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35415
20772024-11-09T01:27:40.229ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 49d235c5-d54d-4258-a645-9d181875557a, kind: Service { id: 34219892-cef8-4169-a366-ce17844120f6 }, name: Name("external-dns-34219892-cef8-4169-a366-ce17844120f6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce088bfb-77e0-4498-b680-d4fab72b0123, kind: Service { id: 530f76d0-bec9-4ae0-beb0-d217f68ae05a }, name: Name("external-dns-530f76d0-bec9-4ae0-beb0-d217f68ae05a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 314cfeab-323e-4445-9502-7e16efd0a788, kind: Service { id: 86b379c9-5608-41ec-a3b2-837d116869db }, name: Name("nexus-86b379c9-5608-41ec-a3b2-837d116869db"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9fa251a1-2d97-4513-b670-a39f36efe9c9, kind: Service { id: 02562f58-d954-43f9-93a1-2ae8426ccbe9 }, name: Name("nexus-02562f58-d954-43f9-93a1-2ae8426ccbe9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b1ef6e1e-4501-48bd-9de3-1d5889b6ea55, kind: Service { id: d59d4e08-d131-4d11-8244-662923dd9357 }, name: Name("nexus-d59d4e08-d131-4d11-8244-662923dd9357"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 166])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20782024-11-09T01:27:40.229ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20792024-11-09T01:27:40.229ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20802024-11-09T01:27:40.229ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
20812024-11-09T01:27:40.229ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20822024-11-09T01:27:40.229ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20832024-11-09T01:27:40.229ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20842024-11-09T01:27:40.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 325 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35415 req_id = 47f00e15-eede-4e43-8753-41df7e3be8dd response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20852024-11-09T01:27:40.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41138
20862024-11-09T01:27:40.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41138 req_id = 0ec9393c-9b19-4806-98ba-0417c4424976 response_code = 200 uri = /vpc-routes
20872024-11-09T01:27:40.277ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
20882024-11-09T01:27:40.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41138 req_id = 222051c3-c3ed-4268-922b-cc19899dcc41 response_code = 204 uri = /eip-gateways
20892024-11-09T01:27:40.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41138 req_id = d0ad146d-33d3-497b-9791-7c3e8e4ca904 response_code = 204 uri = /vpc-routes
20902024-11-09T01:27:40.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51517
20912024-11-09T01:27:40.415ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 49d235c5-d54d-4258-a645-9d181875557a, kind: Service { id: 34219892-cef8-4169-a366-ce17844120f6 }, name: Name("external-dns-34219892-cef8-4169-a366-ce17844120f6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce088bfb-77e0-4498-b680-d4fab72b0123, kind: Service { id: 530f76d0-bec9-4ae0-beb0-d217f68ae05a }, name: Name("external-dns-530f76d0-bec9-4ae0-beb0-d217f68ae05a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 314cfeab-323e-4445-9502-7e16efd0a788, kind: Service { id: 86b379c9-5608-41ec-a3b2-837d116869db }, name: Name("nexus-86b379c9-5608-41ec-a3b2-837d116869db"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9fa251a1-2d97-4513-b670-a39f36efe9c9, kind: Service { id: 02562f58-d954-43f9-93a1-2ae8426ccbe9 }, name: Name("nexus-02562f58-d954-43f9-93a1-2ae8426ccbe9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b1ef6e1e-4501-48bd-9de3-1d5889b6ea55, kind: Service { id: d59d4e08-d131-4d11-8244-662923dd9357 }, name: Name("nexus-d59d4e08-d131-4d11-8244-662923dd9357"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 166])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20922024-11-09T01:27:40.415ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20932024-11-09T01:27:40.415ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20942024-11-09T01:27:40.415ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
20952024-11-09T01:27:40.415ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20962024-11-09T01:27:40.415ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20972024-11-09T01:27:40.415ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20982024-11-09T01:27:40.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51517 req_id = 493ff95f-2603-40fd-b866-2d3bf751a9c1 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20992024-11-09T01:27:40.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43584
21002024-11-09T01:27:40.501ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21012024-11-09T01:27:40.537ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21022024-11-09T01:27:40.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92213 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43584 req_id = e684874e-2771-40ba-9c77-386c4b6b7c90 response_code = 204 uri = /switch-ports
21032024-11-09T01:27:40.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 717 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43584 req_id = 751b02ae-d4fe-476b-91e9-62177ab0b4ef response_code = 200 uri = /network-bootstore-config
21042024-11-09T01:27:50.716ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33306
21052024-11-09T01:27:50.717ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 73 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33306 req_id = 36662a16-8873-4b8c-b733-a6800b770109 response_code = 200 uri = /baseboard
21062024-11-09T01:28:09.280ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40091
21072024-11-09T01:28:09.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40091 req_id = 5ad0aa5f-7e50-42ef-a67d-4d9b28688584 response_code = 200 uri = /vpc-routes
21082024-11-09T01:28:09.322ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
21092024-11-09T01:28:09.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40091 req_id = 0ca30a77-2364-46ea-bb25-f6329b0de916 response_code = 204 uri = /eip-gateways
21102024-11-09T01:28:09.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40091 req_id = 6ae95911-e455-4e44-b9cd-5a6d82236ac3 response_code = 204 uri = /vpc-routes
21112024-11-09T01:28:09.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35635
21122024-11-09T01:28:09.367ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21132024-11-09T01:28:09.410ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21142024-11-09T01:28:09.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99081 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35635 req_id = cc4e2d93-3157-49b1-8dba-05ee45a57b6d response_code = 204 uri = /switch-ports
21152024-11-09T01:28:09.466ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41089
21162024-11-09T01:28:09.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41089 req_id = 581405a9-b22a-4b54-bd73-85259910e334 response_code = 200 uri = /v2p
21172024-11-09T01:28:09.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35635 req_id = bb430582-14b8-4fba-a02a-540c01b7b6f1 response_code = 200 uri = /network-bootstore-config
21182024-11-09T01:28:09.763ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52555
21192024-11-09T01:28:09.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52555 req_id = 766027e8-ed4f-4cc4-a048-0c204900f320 response_code = 200 uri = /vpc-routes
21202024-11-09T01:28:09.779ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
21212024-11-09T01:28:09.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52555 req_id = 98d1d19f-c92d-46e2-a430-d1b75144cf44 response_code = 204 uri = /eip-gateways
21222024-11-09T01:28:09.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52555 req_id = 32a684e8-5b66-43d0-8426-a3bd53883bc2 response_code = 204 uri = /vpc-routes
21232024-11-09T01:28:09.891ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57304
21242024-11-09T01:28:09.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57304 req_id = 3e22e8ff-9ccd-4eef-adb7-c498995a2eed response_code = 200 uri = /v2p
21252024-11-09T01:28:09.925ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48118
21262024-11-09T01:28:09.925ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21272024-11-09T01:28:09.967ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21282024-11-09T01:28:10.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104445 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48118 req_id = 6e56c67b-69aa-40fe-b590-fdd12d62748e response_code = 204 uri = /switch-ports
21292024-11-09T01:28:10.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38404
21302024-11-09T01:28:10.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38404 req_id = 9e9cffe2-67c8-416c-80ac-21057bb64df5 response_code = 200 uri = /vpc-routes
21312024-11-09T01:28:10.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48118 req_id = 22c7075e-fc5e-479e-81c5-716839475d32 response_code = 200 uri = /network-bootstore-config
21322024-11-09T01:28:10.070ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
21332024-11-09T01:28:10.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38404 req_id = 9c807fc0-5bac-45be-9797-18fa4130b88c response_code = 204 uri = /eip-gateways
21342024-11-09T01:28:10.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49768
21352024-11-09T01:28:10.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49768 req_id = 2a504dd6-0c8d-40dc-89b1-16dd009f432b response_code = 200 uri = /v2p
21362024-11-09T01:28:10.098ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45698
21372024-11-09T01:28:10.098ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21382024-11-09T01:28:10.137ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21392024-11-09T01:28:10.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96630 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45698 req_id = d9845a38-25a1-4129-b4a0-c01e4306ef30 response_code = 204 uri = /switch-ports
21402024-11-09T01:28:10.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38404 req_id = c97bea5d-dfdd-4261-8dd0-95f888f19c61 response_code = 204 uri = /vpc-routes
21412024-11-09T01:28:10.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45698 req_id = f334004f-e14c-4fec-98d9-7e55be408d4f response_code = 200 uri = /network-bootstore-config
21422024-11-09T01:28:20.750ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38703
21432024-11-09T01:28:20.750ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 73 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38703 req_id = f6ad036d-beed-4ce0-a1ff-38166430a4b8 response_code = 200 uri = /baseboard
21442024-11-09T01:28:39.357ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60248
21452024-11-09T01:28:39.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60248 req_id = 16dd9867-aa86-4a9c-b36e-aa3425dce268 response_code = 200 uri = /vpc-routes
21462024-11-09T01:28:39.402ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
21472024-11-09T01:28:39.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60248 req_id = 91105efc-d6d0-4108-9824-d8429c154470 response_code = 204 uri = /eip-gateways
21482024-11-09T01:28:39.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60248 req_id = e4421948-0071-41a1-8254-194b3bea083e response_code = 204 uri = /vpc-routes
21492024-11-09T01:28:39.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64468
21502024-11-09T01:28:39.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64468 req_id = 6ef89226-0820-4812-9b05-ac922a34e821 response_code = 200 uri = /v2p
21512024-11-09T01:28:39.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59895
21522024-11-09T01:28:39.480ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21532024-11-09T01:28:39.520ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21542024-11-09T01:28:39.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 127885 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59895 req_id = 421c0894-9f2e-48f8-88a1-bfa28c80a5df response_code = 204 uri = /switch-ports
21552024-11-09T01:28:39.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59895 req_id = 88185827-0d9c-43fc-968d-2fa81dea5e30 response_code = 200 uri = /network-bootstore-config
21562024-11-09T01:28:39.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53530
21572024-11-09T01:28:39.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53530 req_id = ed66ba44-4906-4db2-8baf-ff24d322d1e7 response_code = 200 uri = /vpc-routes
21582024-11-09T01:28:39.997ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43090
21592024-11-09T01:28:39.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43090 req_id = 70953acd-7796-4e02-9f19-9a432be2369f response_code = 200 uri = /v2p
21602024-11-09T01:28:40.042ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
21612024-11-09T01:28:40.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53530 req_id = 068eabb9-0f7f-495f-b859-6c65e6b3dca2 response_code = 204 uri = /eip-gateways
21622024-11-09T01:28:40.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33192
21632024-11-09T01:28:40.047ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21642024-11-09T01:28:40.091ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21652024-11-09T01:28:40.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109131 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33192 req_id = bb3f5dbf-41b4-4f17-be96-6fabdf1e716b response_code = 204 uri = /switch-ports
21662024-11-09T01:28:40.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47106
21672024-11-09T01:28:40.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33192 req_id = 1e8841e3-3b1a-42fa-bfa3-63dd08706935 response_code = 200 uri = /network-bootstore-config
21682024-11-09T01:28:40.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 410 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53530 req_id = 3835f50a-37cd-491d-857e-c49f9d2498dd response_code = 204 uri = /vpc-routes
21692024-11-09T01:28:40.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47106 req_id = 8150f609-652f-4d13-9db3-b307d5082a72 response_code = 200 uri = /vpc-routes
21702024-11-09T01:28:40.173ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
21712024-11-09T01:28:40.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47106 req_id = 7ab17e7d-2907-4a75-8967-1b5b3d171f2a response_code = 204 uri = /eip-gateways
21722024-11-09T01:28:40.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47106 req_id = 4c94542d-7744-4be2-bf06-4daf2dbc8c58 response_code = 204 uri = /vpc-routes
21732024-11-09T01:28:40.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49220
21742024-11-09T01:28:40.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49220 req_id = fd22c9a2-6b90-4820-ac9a-15dadc94af1d response_code = 200 uri = /v2p
21752024-11-09T01:28:40.341ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54279
21762024-11-09T01:28:40.341ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21772024-11-09T01:28:40.383ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21782024-11-09T01:28:40.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100092 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54279 req_id = a66778cd-f604-4e54-8e17-4648eea4da84 response_code = 204 uri = /switch-ports
21792024-11-09T01:28:40.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54279 req_id = 72d9a2f0-ace4-471c-bf8d-d5ab649fe16c response_code = 200 uri = /network-bootstore-config
21802024-11-09T01:28:50.782ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40544
21812024-11-09T01:28:50.783ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40544 req_id = e9ccc943-9c04-49cf-be92-5a372f9db5d9 response_code = 200 uri = /baseboard
21822024-11-09T01:29:09.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42843
21832024-11-09T01:29:09.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42843 req_id = 2e225920-84b4-41b2-b5db-5445fb4e16d4 response_code = 200 uri = /vpc-routes
21842024-11-09T01:29:09.350ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
21852024-11-09T01:29:09.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42843 req_id = 6e0d5685-3f9a-477c-b522-6333fa6ed685 response_code = 204 uri = /eip-gateways
21862024-11-09T01:29:09.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42843 req_id = 827ce89a-c110-41d5-8234-e3352ecbbaba response_code = 204 uri = /vpc-routes
21872024-11-09T01:29:09.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42483
21882024-11-09T01:29:09.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42483 req_id = 3cb830a0-a875-4f3c-9149-a6791b2d4011 response_code = 200 uri = /v2p
21892024-11-09T01:29:09.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52242
21902024-11-09T01:29:09.484ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21912024-11-09T01:29:09.525ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21922024-11-09T01:29:09.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 121812 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52242 req_id = 96726dcf-0ee8-4a57-953f-9a6fc98fd243 response_code = 204 uri = /switch-ports
21932024-11-09T01:29:09.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52242 req_id = 1f5df377-0071-4492-aa97-0ed9feed8c70 response_code = 200 uri = /network-bootstore-config
21942024-11-09T01:29:09.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63939
21952024-11-09T01:29:09.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63939 req_id = 41f43e84-c96a-4a55-ba2b-863c62260d1d response_code = 200 uri = /v2p
21962024-11-09T01:29:09.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48909
21972024-11-09T01:29:09.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48909 req_id = 7e282f3a-e652-44e8-a8a4-fc5b293db716 response_code = 200 uri = /vpc-routes
21982024-11-09T01:29:09.896ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60085
21992024-11-09T01:29:09.896ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22002024-11-09T01:29:09.939ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22012024-11-09T01:29:09.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100547 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60085 req_id = 5bd376f4-ba34-40ec-a6e5-7dd5b962eb1a response_code = 204 uri = /switch-ports
22022024-11-09T01:29:09.997ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60978
22032024-11-09T01:29:09.997ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
22042024-11-09T01:29:09.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48909 req_id = c29d0b47-fa3e-4eea-b577-dbe4cf9db23c response_code = 204 uri = /eip-gateways
22052024-11-09T01:29:09.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60978 req_id = 5caac96c-780a-4e0d-a30f-3455ff38c5e7 response_code = 200 uri = /vpc-routes
22062024-11-09T01:29:09.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60085 req_id = ecdc8181-f035-4bc7-a50a-1ec14705d644 response_code = 200 uri = /network-bootstore-config
22072024-11-09T01:29:10.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47759
22082024-11-09T01:29:10.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47759 req_id = d34c6692-9a59-4a6c-ac7a-2e923c21609f response_code = 200 uri = /v2p
22092024-11-09T01:29:10.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48909 req_id = 19431f6a-a477-40dc-b7fb-95e0574662e1 response_code = 204 uri = /vpc-routes
22102024-11-09T01:29:10.019ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
22112024-11-09T01:29:10.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60978 req_id = 40d26992-a5b0-4a2c-b162-9d3d59ab6d2b response_code = 204 uri = /eip-gateways
22122024-11-09T01:29:10.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60978 req_id = 63cba516-ca95-4f31-8127-fe4619982dd5 response_code = 204 uri = /vpc-routes
22132024-11-09T01:29:10.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39753
22142024-11-09T01:29:10.076ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22152024-11-09T01:29:10.116ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22162024-11-09T01:29:10.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101431 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39753 req_id = e28db0b9-ec40-4e3d-b79f-b528b577b7ee response_code = 204 uri = /switch-ports
22172024-11-09T01:29:10.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39753 req_id = c2528335-f210-49c7-8831-39eb997549a7 response_code = 200 uri = /network-bootstore-config
22182024-11-09T01:29:20.818ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49399
22192024-11-09T01:29:20.819ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 78 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49399 req_id = 5513d574-c1d5-4979-b40e-8322be90b27f response_code = 200 uri = /baseboard
22202024-11-09T01:29:39.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36318
22212024-11-09T01:29:39.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36318 req_id = aa6a5b1e-88f1-4a86-988e-811e5106edb6 response_code = 200 uri = /vpc-routes
22222024-11-09T01:29:39.610ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
22232024-11-09T01:29:39.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36318 req_id = e783d068-bd00-42f8-a44f-09e741d1d920 response_code = 204 uri = /eip-gateways
22242024-11-09T01:29:39.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36318 req_id = bc0a415b-3172-4ce4-a284-22ff1269cae4 response_code = 204 uri = /vpc-routes
22252024-11-09T01:29:39.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47876
22262024-11-09T01:29:39.750ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22272024-11-09T01:29:39.800ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22282024-11-09T01:29:39.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 152888 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47876 req_id = 0a293118-3503-4a29-a4e6-a26a890ba8ad response_code = 204 uri = /switch-ports
22292024-11-09T01:29:39.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52633
22302024-11-09T01:29:39.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63285
22312024-11-09T01:29:39.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63285 req_id = ba7d8f0c-48fd-428e-a5c2-30ee420ec006 response_code = 200 uri = /v2p
22322024-11-09T01:29:39.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47876 req_id = bf1769e6-d76d-483a-aae5-4cbb2c96c2ba response_code = 200 uri = /network-bootstore-config
22332024-11-09T01:29:39.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52633 req_id = 9545e1b0-1646-4ef9-983c-3049ed0a1d87 response_code = 200 uri = /vpc-routes
22342024-11-09T01:29:39.953ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
22352024-11-09T01:29:39.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52633 req_id = a7a5db6f-78ff-4517-97b3-01d1de168c04 response_code = 204 uri = /eip-gateways
22362024-11-09T01:29:39.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47254
22372024-11-09T01:29:39.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47254 req_id = cee2bcff-a8f8-40ab-b5b5-ec9141d062de response_code = 200 uri = /v2p
22382024-11-09T01:29:39.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52633 req_id = 0a5b28fd-30fe-4a69-b701-5723fb142ff2 response_code = 204 uri = /vpc-routes
22392024-11-09T01:29:40.030ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41253
22402024-11-09T01:29:40.030ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22412024-11-09T01:29:40.072ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22422024-11-09T01:29:40.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101220 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41253 req_id = 6398f755-116a-4c3b-a3ac-c1fb27abbb1d response_code = 204 uri = /switch-ports
22432024-11-09T01:29:40.131ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47243
22442024-11-09T01:29:40.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47243 req_id = 830d4c21-45e7-4e50-b824-3d5f5f840a4d response_code = 200 uri = /v2p
22452024-11-09T01:29:40.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41253 req_id = 697e47ad-306d-4402-9ab7-b49862f9d933 response_code = 200 uri = /network-bootstore-config
22462024-11-09T01:29:40.241ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37886
22472024-11-09T01:29:40.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37886 req_id = 187edd6e-b53d-402d-ba0c-f121e6928d71 response_code = 200 uri = /vpc-routes
22482024-11-09T01:29:40.266ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
22492024-11-09T01:29:40.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37886 req_id = 18c540e8-1ec4-41b4-91ba-494bf6dc44eb response_code = 204 uri = /eip-gateways
22502024-11-09T01:29:40.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37886 req_id = db96d3f1-c06e-42ac-8a2e-6869185edba6 response_code = 204 uri = /vpc-routes
22512024-11-09T01:29:40.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62011
22522024-11-09T01:29:40.437ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22532024-11-09T01:29:40.478ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22542024-11-09T01:29:40.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102741 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62011 req_id = 8349b7b0-5d9a-425c-8ee0-53758c36fc24 response_code = 204 uri = /switch-ports
22552024-11-09T01:29:40.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62011 req_id = 0c6cf043-1372-413e-a006-924f3cc3154d response_code = 200 uri = /network-bootstore-config
22562024-11-09T01:29:44.326ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22572024-11-09T01:29:44.329ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22582024-11-09T01:29:44.330ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22592024-11-09T01:29:44.331ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22602024-11-09T01:29:44.360ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22612024-11-09T01:29:44.368ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22622024-11-09T01:29:44.369ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22632024-11-09T01:29:44.371ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22642024-11-09T01:29:44.371ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22652024-11-09T01:29:50.851ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39059
22662024-11-09T01:29:50.851ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39059 req_id = d92ce249-287a-4417-9d73-86b57be63df2 response_code = 200 uri = /baseboard
22672024-11-09T01:29:53.906ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22682024-11-09T01:29:53.907ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22692024-11-09T01:29:53.908ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22702024-11-09T01:29:53.937ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22712024-11-09T01:29:54.282ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22722024-11-09T01:29:54.283ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22732024-11-09T01:29:54.318ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22742024-11-09T01:29:54.326ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22752024-11-09T01:29:54.328ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22762024-11-09T01:29:54.331ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22772024-11-09T01:29:54.331ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22782024-11-09T01:29:54.333ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22792024-11-09T01:29:54.362ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22802024-11-09T01:29:54.368ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22812024-11-09T01:29:54.370ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22822024-11-09T01:29:54.371ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22832024-11-09T01:29:54.372ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22842024-11-09T01:29:54.373ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22852024-11-09T01:30:03.910ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22862024-11-09T01:30:03.911ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22872024-11-09T01:30:03.912ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22882024-11-09T01:30:03.939ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22892024-11-09T01:30:04.284ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22902024-11-09T01:30:04.284ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22912024-11-09T01:30:04.320ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22922024-11-09T01:30:04.328ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22932024-11-09T01:30:04.330ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22942024-11-09T01:30:04.333ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22952024-11-09T01:30:04.333ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22962024-11-09T01:30:04.335ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22972024-11-09T01:30:04.363ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22982024-11-09T01:30:04.369ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
22992024-11-09T01:30:04.372ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23002024-11-09T01:30:04.373ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23012024-11-09T01:30:04.374ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23022024-11-09T01:30:04.375ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23032024-11-09T01:30:09.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49524
23042024-11-09T01:30:09.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49524 req_id = 56f135b2-4409-42c8-992f-f563662bb3b6 response_code = 200 uri = /vpc-routes
23052024-11-09T01:30:09.324ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
23062024-11-09T01:30:09.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49524 req_id = 9d6cb612-6125-4018-8ed7-6ab0f173a345 response_code = 204 uri = /eip-gateways
23072024-11-09T01:30:09.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49524 req_id = 1dc48993-2ebb-4194-955c-2fa900edf1af response_code = 204 uri = /vpc-routes
23082024-11-09T01:30:09.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45763
23092024-11-09T01:30:09.339ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23102024-11-09T01:30:09.380ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23112024-11-09T01:30:09.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101798 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45763 req_id = f3e72ea3-6fb6-4d91-a917-61e50f4d9bba response_code = 204 uri = /switch-ports
23122024-11-09T01:30:09.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62586
23132024-11-09T01:30:09.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62586 req_id = ead43cca-b1c7-4ee7-b740-dc2f8e754e9a response_code = 200 uri = /v2p
23142024-11-09T01:30:09.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45763 req_id = 6d6503d3-110e-44eb-a9e4-014700086520 response_code = 200 uri = /network-bootstore-config
23152024-11-09T01:30:09.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32847
23162024-11-09T01:30:09.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32847 req_id = 15e8bdc8-a65a-4cb5-980c-b351e143cc7a response_code = 200 uri = /vpc-routes
23172024-11-09T01:30:09.716ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
23182024-11-09T01:30:09.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32847 req_id = 4f419cc1-8bbe-4a0c-81b4-ceefa6f585dc response_code = 204 uri = /eip-gateways
23192024-11-09T01:30:09.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32847 req_id = 00a4cf3b-1594-426a-8018-8a20b881c403 response_code = 204 uri = /vpc-routes
23202024-11-09T01:30:09.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39660
23212024-11-09T01:30:09.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39660 req_id = 555e99cb-4203-4a0d-bc0e-ab455168af8c response_code = 200 uri = /v2p
23222024-11-09T01:30:10.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57066
23232024-11-09T01:30:10.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57066 req_id = 56319041-b907-481a-b254-ae884d435bc9 response_code = 200 uri = /vpc-routes
23242024-11-09T01:30:10.077ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
23252024-11-09T01:30:10.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57066 req_id = 00338dcc-4f61-45c4-85cc-2d207ff36068 response_code = 204 uri = /eip-gateways
23262024-11-09T01:30:10.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57066 req_id = 12545e5a-3a30-4865-adac-70a1cec4cccb response_code = 204 uri = /vpc-routes
23272024-11-09T01:30:10.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35934
23282024-11-09T01:30:10.102ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23292024-11-09T01:30:10.146ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23302024-11-09T01:30:10.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106048 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35934 req_id = 9608e361-b847-40e8-9c3f-bc97eb867446 response_code = 204 uri = /switch-ports
23312024-11-09T01:30:10.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48980
23322024-11-09T01:30:10.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45550
23332024-11-09T01:30:10.208ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23342024-11-09T01:30:10.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4004 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45550 req_id = f265b453-5c54-4678-ad4c-6d84ff4cd425 response_code = 200 uri = /v2p
23352024-11-09T01:30:10.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35934 req_id = 760e92d3-0694-4b81-8e08-a4f7572dfc7c response_code = 200 uri = /network-bootstore-config
23362024-11-09T01:30:10.243ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23372024-11-09T01:30:10.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88704 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48980 req_id = 6f0977d3-94c2-4a9b-b8dc-8dd9dfc1a6cf response_code = 204 uri = /switch-ports
23382024-11-09T01:30:10.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48980 req_id = b99905e5-22af-4656-884f-de89c267de2c response_code = 200 uri = /network-bootstore-config
23392024-11-09T01:30:13.913ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23402024-11-09T01:30:13.914ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23412024-11-09T01:30:13.915ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23422024-11-09T01:30:13.941ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23432024-11-09T01:30:14.286ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23442024-11-09T01:30:14.287ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23452024-11-09T01:30:14.322ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23462024-11-09T01:30:14.330ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23472024-11-09T01:30:14.333ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23482024-11-09T01:30:14.334ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23492024-11-09T01:30:14.335ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23502024-11-09T01:30:14.337ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23512024-11-09T01:30:14.365ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23522024-11-09T01:30:14.372ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23532024-11-09T01:30:14.374ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23542024-11-09T01:30:14.375ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23552024-11-09T01:30:14.375ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23562024-11-09T01:30:14.376ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23572024-11-09T01:30:15.609ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23582024-11-09T01:30:15.609ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
23592024-11-09T01:30:15.657ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1732, tv_nsec: 675880019 } time_to_next_cleanup = 599.99999588s
23602024-11-09T01:30:20.885ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39757
23612024-11-09T01:30:20.885ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39757 req_id = a9d4842b-a75f-486f-bf7d-d303b3d78bfd response_code = 200 uri = /baseboard
23622024-11-09T01:30:23.917ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23632024-11-09T01:30:23.918ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23642024-11-09T01:30:23.919ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23652024-11-09T01:30:23.943ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23662024-11-09T01:30:24.288ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23672024-11-09T01:30:24.289ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23682024-11-09T01:30:24.325ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23692024-11-09T01:30:24.333ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23702024-11-09T01:30:24.334ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23712024-11-09T01:30:24.336ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23722024-11-09T01:30:24.336ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23732024-11-09T01:30:24.339ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23742024-11-09T01:30:24.366ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23752024-11-09T01:30:24.373ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23762024-11-09T01:30:24.376ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23772024-11-09T01:30:24.377ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23782024-11-09T01:30:24.377ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23792024-11-09T01:30:24.378ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23802024-11-09T01:30:30.140ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23812024-11-09T01:30:33.921ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23822024-11-09T01:30:33.922ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23832024-11-09T01:30:33.923ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23842024-11-09T01:30:33.945ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23852024-11-09T01:30:34.290ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23862024-11-09T01:30:34.291ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23872024-11-09T01:30:34.326ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23882024-11-09T01:30:34.335ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23892024-11-09T01:30:34.336ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23902024-11-09T01:30:34.338ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23912024-11-09T01:30:34.339ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23922024-11-09T01:30:34.341ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23932024-11-09T01:30:34.368ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23942024-11-09T01:30:34.375ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23952024-11-09T01:30:34.379ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23962024-11-09T01:30:34.379ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23972024-11-09T01:30:34.380ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23982024-11-09T01:30:34.380ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
23992024-11-09T01:30:39.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39123
24002024-11-09T01:30:39.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39123 req_id = d2288fb2-903c-474f-9cd0-408143504791 response_code = 200 uri = /vpc-routes
24012024-11-09T01:30:39.606ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
24022024-11-09T01:30:39.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39123 req_id = 46017e79-49c8-4238-9ac1-9b171824cf06 response_code = 204 uri = /eip-gateways
24032024-11-09T01:30:39.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41229
24042024-11-09T01:30:39.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41229 req_id = ad068eb8-f378-4537-90e8-727c3f37bf13 response_code = 200 uri = /v2p
24052024-11-09T01:30:39.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45438
24062024-11-09T01:30:39.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45438 req_id = 32074ded-cf11-48cb-953b-729c2f581de0 response_code = 200 uri = /vpc-routes
24072024-11-09T01:30:39.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39123 req_id = 413a93e5-2334-461f-99b4-8008737fc55f response_code = 204 uri = /vpc-routes
24082024-11-09T01:30:39.842ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53297
24092024-11-09T01:30:39.842ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24102024-11-09T01:30:39.900ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24112024-11-09T01:30:39.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 130309 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53297 req_id = 2f70619d-e735-460e-a36c-72a3dd00399a response_code = 204 uri = /switch-ports
24122024-11-09T01:30:39.973ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
24132024-11-09T01:30:39.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45438 req_id = 5a98a579-c586-4c02-8ff7-a3a6146febd7 response_code = 204 uri = /eip-gateways
24142024-11-09T01:30:39.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53297 req_id = d5187e22-c26e-4207-a89d-7566b1b26eba response_code = 200 uri = /network-bootstore-config
24152024-11-09T01:30:39.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45438 req_id = 22510645-1a53-49ed-8eb1-09722572e5b4 response_code = 204 uri = /vpc-routes
24162024-11-09T01:30:40.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53063
24172024-11-09T01:30:40.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53063 req_id = 03b9ce81-efab-40df-aedd-6fa96f00f8ad response_code = 200 uri = /v2p
24182024-11-09T01:30:40.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38529
24192024-11-09T01:30:40.023ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24202024-11-09T01:30:40.064ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24212024-11-09T01:30:40.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92446 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38529 req_id = 22d9b36b-0537-430f-af78-f5cf02d789e7 response_code = 204 uri = /switch-ports
24222024-11-09T01:30:40.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43351
24232024-11-09T01:30:40.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43351 req_id = 6772333c-47f2-4353-907d-750dc1f48cc8 response_code = 200 uri = /vpc-routes
24242024-11-09T01:30:40.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38529 req_id = 7f9a0fcd-2a5d-466b-b62e-9a629334702a response_code = 200 uri = /network-bootstore-config
24252024-11-09T01:30:40.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37420
24262024-11-09T01:30:40.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37420 req_id = e57184d8-b7de-46bb-b1e9-4126dc883d0c response_code = 200 uri = /v2p
24272024-11-09T01:30:40.224ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
24282024-11-09T01:30:40.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43351 req_id = 2cfc2ca4-342a-4bfd-af43-00e109f22cb3 response_code = 204 uri = /eip-gateways
24292024-11-09T01:30:40.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43351 req_id = ce7d1f2b-d093-4540-917b-6ab916dad930 response_code = 204 uri = /vpc-routes
24302024-11-09T01:30:40.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55390
24312024-11-09T01:30:40.436ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24322024-11-09T01:30:40.475ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24332024-11-09T01:30:40.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99184 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55390 req_id = 4b482855-879c-4844-b430-69981ed3756d response_code = 204 uri = /switch-ports
24342024-11-09T01:30:40.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55390 req_id = 7ee08620-f93a-46e2-83e8-d82fd25c39a5 response_code = 200 uri = /network-bootstore-config
24352024-11-09T01:30:43.925ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24362024-11-09T01:30:43.926ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24372024-11-09T01:30:43.927ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24382024-11-09T01:30:43.947ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24392024-11-09T01:30:44.292ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24402024-11-09T01:30:44.293ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24412024-11-09T01:30:44.329ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24422024-11-09T01:30:44.337ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24432024-11-09T01:30:44.338ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24442024-11-09T01:30:44.340ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24452024-11-09T01:30:44.341ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24462024-11-09T01:30:44.343ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24472024-11-09T01:30:44.370ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24482024-11-09T01:30:44.377ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24492024-11-09T01:30:44.381ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24502024-11-09T01:30:44.381ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24512024-11-09T01:30:44.382ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24522024-11-09T01:30:44.382ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24532024-11-09T01:30:50.919ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47645
24542024-11-09T01:30:50.919ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47645 req_id = 3a4e2d13-c9fd-45b3-8e3e-b26e36996151 response_code = 200 uri = /baseboard
24552024-11-09T01:30:53.929ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24562024-11-09T01:30:53.930ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24572024-11-09T01:30:53.931ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24582024-11-09T01:30:53.949ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24592024-11-09T01:30:54.295ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24602024-11-09T01:30:54.295ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24612024-11-09T01:30:54.330ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24622024-11-09T01:30:54.338ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24632024-11-09T01:30:54.340ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24642024-11-09T01:30:54.342ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24652024-11-09T01:30:54.342ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24662024-11-09T01:30:54.345ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24672024-11-09T01:30:54.371ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24682024-11-09T01:30:54.378ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24692024-11-09T01:30:54.382ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24702024-11-09T01:30:54.383ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24712024-11-09T01:30:54.384ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24722024-11-09T01:30:54.384ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24732024-11-09T01:31:03.933ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24742024-11-09T01:31:03.934ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24752024-11-09T01:31:03.934ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24762024-11-09T01:31:03.951ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24772024-11-09T01:31:04.296ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24782024-11-09T01:31:04.298ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24792024-11-09T01:31:04.333ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24802024-11-09T01:31:04.341ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24812024-11-09T01:31:04.341ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24822024-11-09T01:31:04.343ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24832024-11-09T01:31:04.345ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24842024-11-09T01:31:04.347ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24852024-11-09T01:31:04.374ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24862024-11-09T01:31:04.380ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24872024-11-09T01:31:04.384ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24882024-11-09T01:31:04.385ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24892024-11-09T01:31:04.385ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24902024-11-09T01:31:04.387ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
24912024-11-09T01:31:09.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37723
24922024-11-09T01:31:09.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37723 req_id = 667ced0d-a191-4cec-94ee-4285aa24bd92 response_code = 200 uri = /vpc-routes
24932024-11-09T01:31:09.310ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
24942024-11-09T01:31:09.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37723 req_id = da5d631f-1611-4847-bb03-846d1a14ab0a response_code = 204 uri = /eip-gateways
24952024-11-09T01:31:09.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60615
24962024-11-09T01:31:09.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60615 req_id = e0f5bbd3-c33c-46b8-9cbf-d392c07d0574 response_code = 200 uri = /v2p
24972024-11-09T01:31:09.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37723 req_id = 213eec6c-9d2f-4aba-815f-56eb6245a54b response_code = 204 uri = /vpc-routes
24982024-11-09T01:31:09.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34514
24992024-11-09T01:31:09.356ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25002024-11-09T01:31:09.399ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25012024-11-09T01:31:09.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103309 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34514 req_id = 19553736-3611-4d6a-8f31-4e28ebe7cbfb response_code = 204 uri = /switch-ports
25022024-11-09T01:31:09.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34514 req_id = 29f055f5-195e-48b5-bc4c-3a71c8f8b2df response_code = 200 uri = /network-bootstore-config
25032024-11-09T01:31:09.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57321
25042024-11-09T01:31:09.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57321 req_id = 7aaf772b-ada4-4ea6-90b2-5d6aecf56f29 response_code = 200 uri = /vpc-routes
25052024-11-09T01:31:09.773ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
25062024-11-09T01:31:09.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57321 req_id = 9599c2c6-c917-42a9-8a88-c40b1718bc1d response_code = 204 uri = /eip-gateways
25072024-11-09T01:31:09.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37502
25082024-11-09T01:31:09.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37502 req_id = 2e8bf857-612a-4f4d-bcd1-14aaf05b04c0 response_code = 200 uri = /v2p
25092024-11-09T01:31:09.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57321 req_id = 2d6866ea-5e7a-45f0-8faa-a627f2037526 response_code = 204 uri = /vpc-routes
25102024-11-09T01:31:09.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49562
25112024-11-09T01:31:09.863ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25122024-11-09T01:31:09.915ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25132024-11-09T01:31:09.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 129314 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49562 req_id = 3c877e73-d7bc-4fe8-b5e2-3318586cdcba response_code = 204 uri = /switch-ports
25142024-11-09T01:31:09.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59209
25152024-11-09T01:31:09.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59209 req_id = 03fa5037-dfbc-4f01-a0a8-874a407c554c response_code = 200 uri = /vpc-routes
25162024-11-09T01:31:09.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49562 req_id = 153de157-7d43-4885-95c9-79bbed108d50 response_code = 200 uri = /network-bootstore-config
25172024-11-09T01:31:10.034ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
25182024-11-09T01:31:10.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59209 req_id = c2f6204e-a4d4-4814-a8c1-4d77426306ab response_code = 204 uri = /eip-gateways
25192024-11-09T01:31:10.079ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44082
25202024-11-09T01:31:10.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44082 req_id = 1c0f5423-7ef2-4b0c-b27f-474a628107eb response_code = 200 uri = /v2p
25212024-11-09T01:31:10.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59209 req_id = 622022f0-db12-4104-8383-6bc7923867ab response_code = 204 uri = /vpc-routes
25222024-11-09T01:31:10.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45428
25232024-11-09T01:31:10.105ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25242024-11-09T01:31:10.150ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25252024-11-09T01:31:10.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106517 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45428 req_id = c8ccdfc6-9774-4f4d-9e7c-f097c0a53be1 response_code = 204 uri = /switch-ports
25262024-11-09T01:31:10.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45428 req_id = 5e372dd7-4d98-447a-9c33-0efac2e16732 response_code = 200 uri = /network-bootstore-config
25272024-11-09T01:31:13.938ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25282024-11-09T01:31:13.938ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25292024-11-09T01:31:13.939ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25302024-11-09T01:31:13.953ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25312024-11-09T01:31:14.299ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25322024-11-09T01:31:14.300ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25332024-11-09T01:31:14.335ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25342024-11-09T01:31:14.343ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25352024-11-09T01:31:14.344ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25362024-11-09T01:31:14.344ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25372024-11-09T01:31:14.347ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25382024-11-09T01:31:14.349ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25392024-11-09T01:31:14.375ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25402024-11-09T01:31:14.383ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25412024-11-09T01:31:14.386ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25422024-11-09T01:31:14.387ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25432024-11-09T01:31:14.387ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25442024-11-09T01:31:14.389ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25452024-11-09T01:31:20.952ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60687
25462024-11-09T01:31:20.952ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 62 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60687 req_id = 45dedb7f-616d-40ea-a70b-d3304e2c9192 response_code = 200 uri = /baseboard
25472024-11-09T01:31:23.943ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25482024-11-09T01:31:23.944ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25492024-11-09T01:31:23.945ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25502024-11-09T01:31:23.955ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25512024-11-09T01:31:24.301ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25522024-11-09T01:31:24.301ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25532024-11-09T01:31:24.337ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25542024-11-09T01:31:24.345ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25552024-11-09T01:31:24.345ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25562024-11-09T01:31:24.346ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25572024-11-09T01:31:24.349ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25582024-11-09T01:31:24.350ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25592024-11-09T01:31:24.377ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25602024-11-09T01:31:24.385ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25612024-11-09T01:31:24.388ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25622024-11-09T01:31:24.389ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25632024-11-09T01:31:24.389ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25642024-11-09T01:31:24.391ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25652024-11-09T01:31:33.947ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25662024-11-09T01:31:33.948ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25672024-11-09T01:31:33.949ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25682024-11-09T01:31:33.958ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25692024-11-09T01:31:34.303ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25702024-11-09T01:31:34.304ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25712024-11-09T01:31:34.339ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25722024-11-09T01:31:34.347ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25732024-11-09T01:31:34.348ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25742024-11-09T01:31:34.349ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25752024-11-09T01:31:34.350ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25762024-11-09T01:31:34.352ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25772024-11-09T01:31:34.379ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25782024-11-09T01:31:34.386ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25792024-11-09T01:31:34.390ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25802024-11-09T01:31:34.391ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25812024-11-09T01:31:34.391ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25822024-11-09T01:31:34.393ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
25832024-11-09T01:31:39.313ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60595
25842024-11-09T01:31:39.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60595 req_id = af53a30a-e0fa-421e-8aed-cdde6691cbc1 response_code = 200 uri = /vpc-routes
25852024-11-09T01:31:39.377ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
25862024-11-09T01:31:39.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60595 req_id = d144fc03-f597-40e5-b56a-7776535ccd2f response_code = 204 uri = /eip-gateways
25872024-11-09T01:31:39.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60595 req_id = f80d75b0-d267-4867-a162-2d6fa74912c1 response_code = 204 uri = /vpc-routes
25882024-11-09T01:31:39.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38535
25892024-11-09T01:31:39.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38535 req_id = 7a28c5ef-6529-491a-afe3-d3d21f61bce4 response_code = 200 uri = /v2p
25902024-11-09T01:31:39.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56802
25912024-11-09T01:31:39.602ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25922024-11-09T01:31:39.658ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25932024-11-09T01:31:39.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 130442 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56802 req_id = 865587af-224a-4300-af96-a3d5c4fcdaa7 response_code = 204 uri = /switch-ports
25942024-11-09T01:31:39.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56802 req_id = 2c5a43b7-3c58-46da-8e4d-9b01baa1e405 response_code = 200 uri = /network-bootstore-config
25952024-11-09T01:31:39.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54250
25962024-11-09T01:31:39.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54250 req_id = b80cb08f-e5dd-4bb6-baa2-a7906b32c0e3 response_code = 200 uri = /vpc-routes
25972024-11-09T01:31:39.896ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
25982024-11-09T01:31:39.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54250 req_id = 989a5736-a2fc-4d9d-b334-b176e1942035 response_code = 204 uri = /eip-gateways
25992024-11-09T01:31:39.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54250 req_id = 8c16007e-3f72-491f-99ad-8132c4d23f0e response_code = 204 uri = /vpc-routes
26002024-11-09T01:31:40.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50811
26012024-11-09T01:31:40.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50811 req_id = 97192ff7-2c34-4d25-925b-61ed5261d740 response_code = 200 uri = /v2p
26022024-11-09T01:31:40.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63054
26032024-11-09T01:31:40.072ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26042024-11-09T01:31:40.115ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26052024-11-09T01:31:40.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102994 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63054 req_id = b4f5af19-b5d0-49ac-8f65-898bfe60cf21 response_code = 204 uri = /switch-ports
26062024-11-09T01:31:40.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63054 req_id = 01dfd5e1-b600-4f1e-96d7-d12a6dcf7936 response_code = 200 uri = /network-bootstore-config
26072024-11-09T01:31:40.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60199
26082024-11-09T01:31:40.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60199 req_id = c57a9b8c-dc1c-4072-b8d1-70005dc625c6 response_code = 200 uri = /vpc-routes
26092024-11-09T01:31:40.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35817
26102024-11-09T01:31:40.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35817 req_id = 32cdb116-35de-4438-af84-35c32c60c801 response_code = 200 uri = /v2p
26112024-11-09T01:31:40.279ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
26122024-11-09T01:31:40.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60199 req_id = b9063817-f1a6-4ccc-b742-3327e712ad91 response_code = 204 uri = /eip-gateways
26132024-11-09T01:31:40.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38793
26142024-11-09T01:31:40.288ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26152024-11-09T01:31:40.330ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26162024-11-09T01:31:40.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106466 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38793 req_id = 3654a44c-2ee7-4d6a-9e08-9b13bfb8b011 response_code = 204 uri = /switch-ports
26172024-11-09T01:31:40.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60199 req_id = 07056940-1d87-41e1-80fb-4d3d6c8e4989 response_code = 204 uri = /vpc-routes
26182024-11-09T01:31:40.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38793 req_id = 3ba3651d-bc51-42c4-ad36-8810180a59ce response_code = 200 uri = /network-bootstore-config
26192024-11-09T01:31:43.951ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26202024-11-09T01:31:43.952ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26212024-11-09T01:31:43.953ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26222024-11-09T01:31:43.960ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26232024-11-09T01:31:44.305ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26242024-11-09T01:31:44.306ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26252024-11-09T01:31:44.341ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26262024-11-09T01:31:44.349ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26272024-11-09T01:31:44.350ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26282024-11-09T01:31:44.350ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26292024-11-09T01:31:44.352ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26302024-11-09T01:31:44.353ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26312024-11-09T01:31:44.381ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26322024-11-09T01:31:44.387ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26332024-11-09T01:31:44.391ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26342024-11-09T01:31:44.393ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26352024-11-09T01:31:44.393ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26362024-11-09T01:31:44.395ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26372024-11-09T01:31:50.985ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39704
26382024-11-09T01:31:50.985ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39704 req_id = 689c0a52-507d-4f58-a7ce-440534b4eeea response_code = 200 uri = /baseboard
26392024-11-09T01:31:53.955ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26402024-11-09T01:31:53.956ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26412024-11-09T01:31:53.957ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26422024-11-09T01:31:53.962ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26432024-11-09T01:31:54.308ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26442024-11-09T01:31:54.309ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26452024-11-09T01:31:54.343ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26462024-11-09T01:31:54.350ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26472024-11-09T01:31:54.352ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26482024-11-09T01:31:54.353ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26492024-11-09T01:31:54.354ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26502024-11-09T01:31:54.355ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26512024-11-09T01:31:54.383ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26522024-11-09T01:31:54.390ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26532024-11-09T01:31:54.393ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26542024-11-09T01:31:54.395ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26552024-11-09T01:31:54.396ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26562024-11-09T01:31:54.396ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26572024-11-09T01:32:03.959ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26582024-11-09T01:32:03.959ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26592024-11-09T01:32:03.960ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26602024-11-09T01:32:03.964ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26612024-11-09T01:32:04.310ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26622024-11-09T01:32:04.310ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26632024-11-09T01:32:04.344ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26642024-11-09T01:32:04.352ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26652024-11-09T01:32:04.354ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26662024-11-09T01:32:04.354ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26672024-11-09T01:32:04.356ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26682024-11-09T01:32:04.356ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26692024-11-09T01:32:04.385ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26702024-11-09T01:32:04.392ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26712024-11-09T01:32:04.394ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26722024-11-09T01:32:04.397ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26732024-11-09T01:32:04.398ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26742024-11-09T01:32:04.399ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
26752024-11-09T01:32:09.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36301
26762024-11-09T01:32:09.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36301 req_id = 1f4e8dd5-6f48-4bac-89f9-779ede3055a4 response_code = 200 uri = /vpc-routes
26772024-11-09T01:32:09.334ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
26782024-11-09T01:32:09.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36301 req_id = 520e6065-68e3-49cd-ad1a-919b7ba18310 response_code = 204 uri = /eip-gateways
26792024-11-09T01:32:09.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36301 req_id = fed2e57d-b505-4c31-9933-b9f9871e67ba response_code = 204 uri = /vpc-routes
26802024-11-09T01:32:09.366ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34167
26812024-11-09T01:32:09.366ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26822024-11-09T01:32:09.411ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26832024-11-09T01:32:09.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107447 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34167 req_id = 6d995ab4-66ee-4e49-bd0b-46fdde3d0056 response_code = 204 uri = /switch-ports
26842024-11-09T01:32:09.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48638
26852024-11-09T01:32:09.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48638 req_id = 389fca10-ce2e-4ba5-88c4-7bf51f200411 response_code = 200 uri = /v2p
26862024-11-09T01:32:09.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34167 req_id = 81352104-f42b-4643-8042-00e3d0569f47 response_code = 200 uri = /network-bootstore-config
26872024-11-09T01:32:09.666ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64211
26882024-11-09T01:32:09.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64211 req_id = 5b78ad4e-cb00-41af-a6eb-7382828489ed response_code = 200 uri = /vpc-routes
26892024-11-09T01:32:09.680ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
26902024-11-09T01:32:09.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64211 req_id = 946cb878-700e-4653-a7a2-be8ce64c10ea response_code = 204 uri = /eip-gateways
26912024-11-09T01:32:09.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64211 req_id = 670ae3a8-2a8c-4741-9cba-7603a151863e response_code = 204 uri = /vpc-routes
26922024-11-09T01:32:09.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45103
26932024-11-09T01:32:09.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45103 req_id = cf5015ed-9f3d-4181-b7fa-cb48bf35abc5 response_code = 200 uri = /v2p
26942024-11-09T01:32:09.900ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34757
26952024-11-09T01:32:09.900ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26962024-11-09T01:32:09.943ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26972024-11-09T01:32:10.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114459 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34757 req_id = 5813f1b9-0e15-468a-aae2-7be6a8d80ff7 response_code = 204 uri = /switch-ports
26982024-11-09T01:32:10.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51910
26992024-11-09T01:32:10.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51910 req_id = 834ca0c3-0008-4966-8c17-76c365b57196 response_code = 200 uri = /vpc-routes
27002024-11-09T01:32:10.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34757 req_id = 4f4a9048-4cc3-48a3-8706-975dee298b2d response_code = 200 uri = /network-bootstore-config
27012024-11-09T01:32:10.059ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
27022024-11-09T01:32:10.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51910 req_id = cbb9025a-5707-4608-aece-d16e0200caa5 response_code = 204 uri = /eip-gateways
27032024-11-09T01:32:10.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38569
27042024-11-09T01:32:10.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38569 req_id = 40195c60-c9d6-4c8a-a647-685bdc5931b8 response_code = 200 uri = /v2p
27052024-11-09T01:32:10.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51910 req_id = 6b5508e6-cfea-4af2-9e63-b08a63f898f5 response_code = 204 uri = /vpc-routes
27062024-11-09T01:32:10.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35147
27072024-11-09T01:32:10.169ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27082024-11-09T01:32:10.212ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27092024-11-09T01:32:10.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104282 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35147 req_id = 6eaa7fbb-8ab7-41b4-9fa6-b3b92a8f81ff response_code = 204 uri = /switch-ports
27102024-11-09T01:32:10.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35147 req_id = 77d62cd6-3cc6-48f2-95dd-6eeb8c04ab86 response_code = 200 uri = /network-bootstore-config
27112024-11-09T01:32:13.963ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27122024-11-09T01:32:13.963ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27132024-11-09T01:32:13.964ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27142024-11-09T01:32:13.966ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27152024-11-09T01:32:14.313ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27162024-11-09T01:32:14.313ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27172024-11-09T01:32:14.346ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27182024-11-09T01:32:14.354ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27192024-11-09T01:32:14.355ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27202024-11-09T01:32:14.356ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27212024-11-09T01:32:14.357ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27222024-11-09T01:32:14.358ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27232024-11-09T01:32:14.386ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27242024-11-09T01:32:14.394ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27252024-11-09T01:32:14.396ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27262024-11-09T01:32:14.398ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27272024-11-09T01:32:14.400ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27282024-11-09T01:32:14.401ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27292024-11-09T01:32:21.019ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36805
27302024-11-09T01:32:21.019ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36805 req_id = 7aaefb25-4bb7-4140-80f6-0ff299009f20 response_code = 200 uri = /baseboard
27312024-11-09T01:32:23.967ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27322024-11-09T01:32:23.968ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27332024-11-09T01:32:23.968ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27342024-11-09T01:32:23.969ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27352024-11-09T01:32:24.316ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27362024-11-09T01:32:24.316ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27372024-11-09T01:32:24.348ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27382024-11-09T01:32:24.356ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27392024-11-09T01:32:24.357ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27402024-11-09T01:32:24.357ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27412024-11-09T01:32:24.359ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27422024-11-09T01:32:24.359ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27432024-11-09T01:32:24.387ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27442024-11-09T01:32:24.396ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27452024-11-09T01:32:24.399ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27462024-11-09T01:32:24.399ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27472024-11-09T01:32:24.402ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27482024-11-09T01:32:24.403ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27492024-11-09T01:32:33.971ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27502024-11-09T01:32:33.972ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27512024-11-09T01:32:33.973ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27522024-11-09T01:32:33.974ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27532024-11-09T01:32:34.318ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27542024-11-09T01:32:34.319ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27552024-11-09T01:32:34.350ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27562024-11-09T01:32:34.359ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27572024-11-09T01:32:34.359ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27582024-11-09T01:32:34.360ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27592024-11-09T01:32:34.360ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27602024-11-09T01:32:34.361ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27612024-11-09T01:32:34.390ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27622024-11-09T01:32:34.398ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27632024-11-09T01:32:34.400ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27642024-11-09T01:32:34.401ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27652024-11-09T01:32:34.404ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27662024-11-09T01:32:34.405ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
27672024-11-09T01:32:39.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44392
27682024-11-09T01:32:39.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44392 req_id = 4bc2c4f3-441a-4536-b84a-c7fd6b906372 response_code = 200 uri = /vpc-routes
27692024-11-09T01:32:39.714ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
27702024-11-09T01:32:39.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44392 req_id = 0e91b1b5-7808-4745-90ab-44753a3e5162 response_code = 204 uri = /eip-gateways
27712024-11-09T01:32:39.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44392 req_id = 42811ec2-b423-4d35-a756-559ac586d4be response_code = 204 uri = /vpc-routes
27722024-11-09T01:32:39.734ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47129
27732024-11-09T01:32:39.734ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27742024-11-09T01:32:39.785ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27752024-11-09T01:32:39.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 152539 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47129 req_id = 74b70d67-1a7c-4453-9073-4cd76f89ac33 response_code = 204 uri = /switch-ports
27762024-11-09T01:32:39.887ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64968
27772024-11-09T01:32:39.887ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61823
27782024-11-09T01:32:39.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47129 req_id = a9635d7b-d88f-4a2f-bdc5-dc0a7ebd424b response_code = 200 uri = /network-bootstore-config
27792024-11-09T01:32:39.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61823 req_id = 9d40e710-9575-4f37-b660-9faaa6896c17 response_code = 200 uri = /v2p
27802024-11-09T01:32:39.888ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27812024-11-09T01:32:39.888ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27822024-11-09T01:32:39.888ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/omicron-zones.json file = common/src/ledger.rs:177
27832024-11-09T01:32:39.897ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/omicron-zones.json file = common/src/ledger.rs:177
27842024-11-09T01:32:39.915ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27852024-11-09T01:32:39.915ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ab413033-915c-42e6-846f-3f01a7447749
27862024-11-09T01:32:39.940ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33837
27872024-11-09T01:32:39.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33837 req_id = ee158b1b-a496-4763-b90d-acba4ef1d82c response_code = 200 uri = /vpc-routes
27882024-11-09T01:32:39.946ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27892024-11-09T01:32:39.946ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1f0e3af0-a7d2-464f-9192-4fe81acc94c1
27902024-11-09T01:32:39.957ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
27912024-11-09T01:32:39.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33837 req_id = 27fe334c-75c7-428c-86ce-9c49c83b031b response_code = 204 uri = /eip-gateways
27922024-11-09T01:32:39.980ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27932024-11-09T01:32:39.980ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_dfa112e2-c0df-4b06-b74f-0a27df3ed293
27942024-11-09T01:32:40.009ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27952024-11-09T01:32:40.009ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ff1cdd93-8ce7-4ee1-845c-a77798315216
27962024-11-09T01:32:40.018ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59162
27972024-11-09T01:32:40.018ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 49d235c5-d54d-4258-a645-9d181875557a, kind: Service { id: 34219892-cef8-4169-a366-ce17844120f6 }, name: Name("external-dns-34219892-cef8-4169-a366-ce17844120f6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce088bfb-77e0-4498-b680-d4fab72b0123, kind: Service { id: 530f76d0-bec9-4ae0-beb0-d217f68ae05a }, name: Name("external-dns-530f76d0-bec9-4ae0-beb0-d217f68ae05a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 314cfeab-323e-4445-9502-7e16efd0a788, kind: Service { id: 86b379c9-5608-41ec-a3b2-837d116869db }, name: Name("nexus-86b379c9-5608-41ec-a3b2-837d116869db"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9fa251a1-2d97-4513-b670-a39f36efe9c9, kind: Service { id: 02562f58-d954-43f9-93a1-2ae8426ccbe9 }, name: Name("nexus-02562f58-d954-43f9-93a1-2ae8426ccbe9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b1ef6e1e-4501-48bd-9de3-1d5889b6ea55, kind: Service { id: d59d4e08-d131-4d11-8244-662923dd9357 }, name: Name("nexus-d59d4e08-d131-4d11-8244-662923dd9357"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 166])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27982024-11-09T01:32:40.019ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27992024-11-09T01:32:40.019ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28002024-11-09T01:32:40.019ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28012024-11-09T01:32:40.019ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28022024-11-09T01:32:40.019ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28032024-11-09T01:32:40.019ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28042024-11-09T01:32:40.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 403 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59162 req_id = 4a2095dd-6f8b-4a0a-9e4d-853aef4f7c75 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28052024-11-09T01:32:40.034ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28062024-11-09T01:32:40.035ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_fb3197ce-1650-4560-94ee-2bc866b44b0e
28072024-11-09T01:32:40.061ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43709
28082024-11-09T01:32:40.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43709 req_id = 50ff67e4-f086-413e-ab53-65d08b1fbfda response_code = 200 uri = /vpc-routes
28092024-11-09T01:32:40.062ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28102024-11-09T01:32:40.062ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3b61ae58-143a-47f2-a80d-e4aeb0c981fa
28112024-11-09T01:32:40.100ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28122024-11-09T01:32:40.100ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3ddfa1e2-6686-49f9-839e-ea29e37a9969
28132024-11-09T01:32:40.136ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 429a71c0-de37-4c29-9517-d34e0fdea40d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28142024-11-09T01:32:40.136ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_429a71c0-de37-4c29-9517-d34e0fdea40d
28152024-11-09T01:32:40.143ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
28162024-11-09T01:32:40.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7023 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43709 req_id = 424ccb46-122c-4df6-b199-a7815259c3c3 response_code = 204 uri = /eip-gateways
28172024-11-09T01:32:40.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 938 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43709 req_id = 9dd956df-15da-4188-8f75-f3af35960f14 response_code = 204 uri = /vpc-routes
28182024-11-09T01:32:40.168ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28192024-11-09T01:32:40.168ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bf89547e-f293-4d7a-96c8-740a254cce2e
28202024-11-09T01:32:40.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 300668 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64968 req_id = 0171a849-fcab-480c-b90b-38b21e27fcbb response_code = 200 uri = /inventory
28212024-11-09T01:32:40.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35528
28222024-11-09T01:32:40.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35528 req_id = 91927dc0-8314-46c2-9415-941ec7a412a4 response_code = 200 uri = /v2p
28232024-11-09T01:32:40.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41349
28242024-11-09T01:32:40.218ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28252024-11-09T01:32:40.218ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28262024-11-09T01:32:40.218ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/omicron-zones.json file = common/src/ledger.rs:177
28272024-11-09T01:32:40.219ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/omicron-zones.json file = common/src/ledger.rs:177
28282024-11-09T01:32:40.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 886 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33837 req_id = e8c2df3e-19ea-4137-b268-754298aa09f6 response_code = 204 uri = /vpc-routes
28292024-11-09T01:32:40.234ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28302024-11-09T01:32:40.234ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ab413033-915c-42e6-846f-3f01a7447749
28312024-11-09T01:32:40.266ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28322024-11-09T01:32:40.266ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1f0e3af0-a7d2-464f-9192-4fe81acc94c1
28332024-11-09T01:32:40.280ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45818
28342024-11-09T01:32:40.280ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28352024-11-09T01:32:40.300ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28362024-11-09T01:32:40.301ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_dfa112e2-c0df-4b06-b74f-0a27df3ed293
28372024-11-09T01:32:40.324ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28382024-11-09T01:32:40.329ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28392024-11-09T01:32:40.329ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ff1cdd93-8ce7-4ee1-845c-a77798315216
28402024-11-09T01:32:40.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58533
28412024-11-09T01:32:40.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 499 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58533 req_id = 1680ac44-e3a2-40e0-ad4b-609bb93b3032 response_code = 200 uri = /v2p
28422024-11-09T01:32:40.359ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28432024-11-09T01:32:40.359ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_fb3197ce-1650-4560-94ee-2bc866b44b0e
28442024-11-09T01:32:40.393ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28452024-11-09T01:32:40.393ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3b61ae58-143a-47f2-a80d-e4aeb0c981fa
28462024-11-09T01:32:40.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 119637 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45818 req_id = fa1d5bf8-3859-4d01-9770-8de806f2d04b response_code = 204 uri = /switch-ports
28472024-11-09T01:32:40.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45818 req_id = 8199a382-18e4-4601-a16e-dbedd2a78893 response_code = 200 uri = /network-bootstore-config
28482024-11-09T01:32:40.424ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28492024-11-09T01:32:40.424ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3ddfa1e2-6686-49f9-839e-ea29e37a9969
28502024-11-09T01:32:40.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63540
28512024-11-09T01:32:40.441ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28522024-11-09T01:32:40.441ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28532024-11-09T01:32:40.441ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/config/omicron-zones.json file = common/src/ledger.rs:177
28542024-11-09T01:32:40.442ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/config/omicron-zones.json file = common/src/ledger.rs:177
28552024-11-09T01:32:40.450ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 429a71c0-de37-4c29-9517-d34e0fdea40d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28562024-11-09T01:32:40.450ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_429a71c0-de37-4c29-9517-d34e0fdea40d
28572024-11-09T01:32:40.462ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ab413033-915c-42e6-846f-3f01a7447749 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28582024-11-09T01:32:40.462ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ab413033-915c-42e6-846f-3f01a7447749
28592024-11-09T01:32:40.481ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28602024-11-09T01:32:40.481ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bf89547e-f293-4d7a-96c8-740a254cce2e
28612024-11-09T01:32:40.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49181
28622024-11-09T01:32:40.494ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28632024-11-09T01:32:40.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34603
28642024-11-09T01:32:40.501ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 49d235c5-d54d-4258-a645-9d181875557a, kind: Service { id: 34219892-cef8-4169-a366-ce17844120f6 }, name: Name("external-dns-34219892-cef8-4169-a366-ce17844120f6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce088bfb-77e0-4498-b680-d4fab72b0123, kind: Service { id: 530f76d0-bec9-4ae0-beb0-d217f68ae05a }, name: Name("external-dns-530f76d0-bec9-4ae0-beb0-d217f68ae05a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 314cfeab-323e-4445-9502-7e16efd0a788, kind: Service { id: 86b379c9-5608-41ec-a3b2-837d116869db }, name: Name("nexus-86b379c9-5608-41ec-a3b2-837d116869db"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9fa251a1-2d97-4513-b670-a39f36efe9c9, kind: Service { id: 02562f58-d954-43f9-93a1-2ae8426ccbe9 }, name: Name("nexus-02562f58-d954-43f9-93a1-2ae8426ccbe9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b1ef6e1e-4501-48bd-9de3-1d5889b6ea55, kind: Service { id: d59d4e08-d131-4d11-8244-662923dd9357 }, name: Name("nexus-d59d4e08-d131-4d11-8244-662923dd9357"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 166])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28652024-11-09T01:32:40.501ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28662024-11-09T01:32:40.501ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28672024-11-09T01:32:40.501ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28682024-11-09T01:32:40.501ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28692024-11-09T01:32:40.501ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28702024-11-09T01:32:40.501ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28712024-11-09T01:32:40.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 533 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34603 req_id = eeac5caa-0a54-4df6-a87e-8046add81045 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28722024-11-09T01:32:40.504ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1f0e3af0-a7d2-464f-9192-4fe81acc94c1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28732024-11-09T01:32:40.504ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1f0e3af0-a7d2-464f-9192-4fe81acc94c1
28742024-11-09T01:32:40.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 291101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41349 req_id = 4c735a4d-b268-46c5-b0b5-a3e584bdd172 response_code = 200 uri = /inventory
28752024-11-09T01:32:40.532ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dfa112e2-c0df-4b06-b74f-0a27df3ed293 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28762024-11-09T01:32:40.532ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_dfa112e2-c0df-4b06-b74f-0a27df3ed293
28772024-11-09T01:32:40.544ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28782024-11-09T01:32:40.563ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ff1cdd93-8ce7-4ee1-845c-a77798315216 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28792024-11-09T01:32:40.563ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ff1cdd93-8ce7-4ee1-845c-a77798315216
28802024-11-09T01:32:40.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47891
28812024-11-09T01:32:40.569ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 49d235c5-d54d-4258-a645-9d181875557a, kind: Service { id: 34219892-cef8-4169-a366-ce17844120f6 }, name: Name("external-dns-34219892-cef8-4169-a366-ce17844120f6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce088bfb-77e0-4498-b680-d4fab72b0123, kind: Service { id: 530f76d0-bec9-4ae0-beb0-d217f68ae05a }, name: Name("external-dns-530f76d0-bec9-4ae0-beb0-d217f68ae05a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 314cfeab-323e-4445-9502-7e16efd0a788, kind: Service { id: 86b379c9-5608-41ec-a3b2-837d116869db }, name: Name("nexus-86b379c9-5608-41ec-a3b2-837d116869db"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9fa251a1-2d97-4513-b670-a39f36efe9c9, kind: Service { id: 02562f58-d954-43f9-93a1-2ae8426ccbe9 }, name: Name("nexus-02562f58-d954-43f9-93a1-2ae8426ccbe9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b1ef6e1e-4501-48bd-9de3-1d5889b6ea55, kind: Service { id: d59d4e08-d131-4d11-8244-662923dd9357 }, name: Name("nexus-d59d4e08-d131-4d11-8244-662923dd9357"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 166])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28822024-11-09T01:32:40.569ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28832024-11-09T01:32:40.569ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28842024-11-09T01:32:40.569ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28852024-11-09T01:32:40.569ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28862024-11-09T01:32:40.569ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28872024-11-09T01:32:40.569ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28882024-11-09T01:32:40.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 610 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47891 req_id = 7ace1b46-edfc-40f2-9ff4-0524c6b6d5cd response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28892024-11-09T01:32:40.593ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb3197ce-1650-4560-94ee-2bc866b44b0e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28902024-11-09T01:32:40.593ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_fb3197ce-1650-4560-94ee-2bc866b44b0e
28912024-11-09T01:32:40.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 121270 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49181 req_id = 2f63ce28-0c86-479c-929b-70fcdccc311b response_code = 204 uri = /switch-ports
28922024-11-09T01:32:40.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49181 req_id = 2810a3da-fd46-444b-ba5a-ea508dbb365a response_code = 200 uri = /network-bootstore-config
28932024-11-09T01:32:40.622ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3b61ae58-143a-47f2-a80d-e4aeb0c981fa (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28942024-11-09T01:32:40.622ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3b61ae58-143a-47f2-a80d-e4aeb0c981fa
28952024-11-09T01:32:40.650ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3ddfa1e2-6686-49f9-839e-ea29e37a9969 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28962024-11-09T01:32:40.650ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3ddfa1e2-6686-49f9-839e-ea29e37a9969
28972024-11-09T01:32:40.675ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 429a71c0-de37-4c29-9517-d34e0fdea40d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28982024-11-09T01:32:40.675ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_429a71c0-de37-4c29-9517-d34e0fdea40d
28992024-11-09T01:32:40.697ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bf89547e-f293-4d7a-96c8-740a254cce2e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29002024-11-09T01:32:40.698ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bf89547e-f293-4d7a-96c8-740a254cce2e
29012024-11-09T01:32:40.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 270145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63540 req_id = 2868c8a5-448d-4bf8-9a49-2c4767c6e430 response_code = 200 uri = /inventory
29022024-11-09T01:32:43.975ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29032024-11-09T01:32:43.976ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29042024-11-09T01:32:43.977ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29052024-11-09T01:32:43.978ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29062024-11-09T01:32:44.321ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29072024-11-09T01:32:44.321ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29082024-11-09T01:32:44.352ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29092024-11-09T01:32:44.360ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29102024-11-09T01:32:44.361ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29112024-11-09T01:32:44.362ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29122024-11-09T01:32:44.362ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29132024-11-09T01:32:44.363ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29142024-11-09T01:32:44.392ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29152024-11-09T01:32:44.399ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29162024-11-09T01:32:44.402ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29172024-11-09T01:32:44.403ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29182024-11-09T01:32:44.406ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29192024-11-09T01:32:44.407ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29202024-11-09T01:32:51.054ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42396
29212024-11-09T01:32:51.054ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42396 req_id = 5229f406-d12d-4ae1-99f1-ab6d68fbcfff response_code = 200 uri = /baseboard
29222024-11-09T01:32:53.980ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29232024-11-09T01:32:53.981ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29242024-11-09T01:32:53.982ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29252024-11-09T01:32:53.983ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29262024-11-09T01:32:54.323ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29272024-11-09T01:32:54.324ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29282024-11-09T01:32:54.355ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29292024-11-09T01:32:54.363ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29302024-11-09T01:32:54.364ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29312024-11-09T01:32:54.365ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29322024-11-09T01:32:54.365ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29332024-11-09T01:32:54.366ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29342024-11-09T01:32:54.393ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29352024-11-09T01:32:54.401ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29362024-11-09T01:32:54.405ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29372024-11-09T01:32:54.405ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29382024-11-09T01:32:54.408ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29392024-11-09T01:32:54.409ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29402024-11-09T01:33:03.984ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29412024-11-09T01:33:03.985ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29422024-11-09T01:33:03.985ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29432024-11-09T01:33:03.986ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29442024-11-09T01:33:04.325ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29452024-11-09T01:33:04.326ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29462024-11-09T01:33:04.357ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29472024-11-09T01:33:04.366ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29482024-11-09T01:33:04.366ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29492024-11-09T01:33:04.367ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29502024-11-09T01:33:04.367ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29512024-11-09T01:33:04.368ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29522024-11-09T01:33:04.395ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29532024-11-09T01:33:04.402ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29542024-11-09T01:33:04.406ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29552024-11-09T01:33:04.407ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29562024-11-09T01:33:04.410ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29572024-11-09T01:33:04.411ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29582024-11-09T01:33:09.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45973
29592024-11-09T01:33:09.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45973 req_id = a97f0ca9-3062-4d85-9a02-c98571bcafac response_code = 200 uri = /vpc-routes
29602024-11-09T01:33:09.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55453
29612024-11-09T01:33:09.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55453 req_id = 1cf81bd3-4c78-44f1-8c5e-ce4931a774b6 response_code = 200 uri = /v2p
29622024-11-09T01:33:09.353ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
29632024-11-09T01:33:09.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45973 req_id = d3565172-c3d4-420b-ac41-faa4c3c04164 response_code = 204 uri = /eip-gateways
29642024-11-09T01:33:09.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45973 req_id = 08451a1c-bdb0-4f50-8ffa-538d1869a181 response_code = 204 uri = /vpc-routes
29652024-11-09T01:33:09.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39632
29662024-11-09T01:33:09.442ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29672024-11-09T01:33:09.497ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29682024-11-09T01:33:09.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 146985 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39632 req_id = 5c8d1923-f274-41e5-a9aa-7e9cdd000f44 response_code = 204 uri = /switch-ports
29692024-11-09T01:33:09.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39632 req_id = dd9592e0-f246-4c92-8806-0f8d160f6a6c response_code = 200 uri = /network-bootstore-config
29702024-11-09T01:33:09.666ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50772
29712024-11-09T01:33:09.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50772 req_id = c6d00e1e-a415-482c-b2ab-b5840561ed2b response_code = 200 uri = /vpc-routes
29722024-11-09T01:33:09.721ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
29732024-11-09T01:33:09.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50772 req_id = 7991768f-8a68-496f-a37f-94bd3953ae56 response_code = 204 uri = /eip-gateways
29742024-11-09T01:33:09.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50772 req_id = 3ef7ca21-cca2-42ab-9fcb-fe4b991e34d6 response_code = 204 uri = /vpc-routes
29752024-11-09T01:33:09.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55341
29762024-11-09T01:33:09.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55341 req_id = ffc2a5d7-652b-45f7-8f1e-87043d83b3db response_code = 200 uri = /v2p
29772024-11-09T01:33:09.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41826
29782024-11-09T01:33:09.879ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29792024-11-09T01:33:09.920ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29802024-11-09T01:33:09.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118565 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41826 req_id = d97e16eb-eaa4-401c-b556-7fcb81d48f49 response_code = 204 uri = /switch-ports
29812024-11-09T01:33:09.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40230
29822024-11-09T01:33:09.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40230 req_id = ca70ec33-2c33-4294-b73f-292338e60a5c response_code = 200 uri = /vpc-routes
29832024-11-09T01:33:09.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41826 req_id = f4d21d22-036a-4182-8ef5-bf25587cdf4d response_code = 200 uri = /network-bootstore-config
29842024-11-09T01:33:10.040ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
29852024-11-09T01:33:10.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40230 req_id = efc393a7-9fc1-4507-8761-e3b56a37b3ac response_code = 204 uri = /eip-gateways
29862024-11-09T01:33:10.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36050
29872024-11-09T01:33:10.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36050 req_id = 8ed8d166-a936-4c88-8f0c-c55990acf181 response_code = 200 uri = /v2p
29882024-11-09T01:33:10.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40230 req_id = 6cd7a4e4-7980-4da9-88eb-18306f000a92 response_code = 204 uri = /vpc-routes
29892024-11-09T01:33:10.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40136
29902024-11-09T01:33:10.097ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29912024-11-09T01:33:10.140ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29922024-11-09T01:33:10.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103909 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40136 req_id = 0508bf82-60d5-4313-b54b-168e665fe5a9 response_code = 204 uri = /switch-ports
29932024-11-09T01:33:10.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40136 req_id = bc0e9b48-a4e2-4ea1-82f2-5a48d7ba1f47 response_code = 200 uri = /network-bootstore-config
29942024-11-09T01:33:13.987ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29952024-11-09T01:33:13.988ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29962024-11-09T01:33:13.989ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29972024-11-09T01:33:13.990ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29982024-11-09T01:33:14.327ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
29992024-11-09T01:33:14.328ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30002024-11-09T01:33:14.359ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30012024-11-09T01:33:14.367ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30022024-11-09T01:33:14.368ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30032024-11-09T01:33:14.369ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30042024-11-09T01:33:14.369ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30052024-11-09T01:33:14.370ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30062024-11-09T01:33:14.397ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30072024-11-09T01:33:14.404ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30082024-11-09T01:33:14.408ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30092024-11-09T01:33:14.409ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30102024-11-09T01:33:14.411ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30112024-11-09T01:33:14.412ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30122024-11-09T01:33:21.085ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40089
30132024-11-09T01:33:21.085ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40089 req_id = fc59dffc-66f6-4106-a01c-3749e9673429 response_code = 200 uri = /baseboard
30142024-11-09T01:33:23.992ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30152024-11-09T01:33:23.993ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30162024-11-09T01:33:23.994ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30172024-11-09T01:33:23.995ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30182024-11-09T01:33:24.329ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30192024-11-09T01:33:24.330ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30202024-11-09T01:33:24.360ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30212024-11-09T01:33:24.369ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30222024-11-09T01:33:24.370ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30232024-11-09T01:33:24.371ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30242024-11-09T01:33:24.371ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30252024-11-09T01:33:24.372ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30262024-11-09T01:33:24.400ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30272024-11-09T01:33:24.405ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30282024-11-09T01:33:24.410ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30292024-11-09T01:33:24.412ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30302024-11-09T01:33:24.412ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30312024-11-09T01:33:24.415ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30322024-11-09T01:33:33.997ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30332024-11-09T01:33:33.998ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30342024-11-09T01:33:33.999ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30352024-11-09T01:33:34.000ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30362024-11-09T01:33:34.330ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30372024-11-09T01:33:34.331ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30382024-11-09T01:33:34.363ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30392024-11-09T01:33:34.371ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30402024-11-09T01:33:34.372ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30412024-11-09T01:33:34.373ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30422024-11-09T01:33:34.373ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30432024-11-09T01:33:34.374ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30442024-11-09T01:33:34.401ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30452024-11-09T01:33:34.407ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30462024-11-09T01:33:34.412ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30472024-11-09T01:33:34.414ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30482024-11-09T01:33:34.414ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30492024-11-09T01:33:34.417ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30502024-11-09T01:33:39.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41053
30512024-11-09T01:33:39.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41053 req_id = e858fe00-2564-45aa-87a3-3ac3deddd22e response_code = 200 uri = /vpc-routes
30522024-11-09T01:33:39.365ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
30532024-11-09T01:33:39.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41053 req_id = 9fe15076-c51c-4d3d-a3e8-d1557f748efd response_code = 204 uri = /eip-gateways
30542024-11-09T01:33:39.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41053 req_id = 45b0e737-5f9a-4619-9054-cde1c492a023 response_code = 204 uri = /vpc-routes
30552024-11-09T01:33:39.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47731
30562024-11-09T01:33:39.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47731 req_id = 88771418-38b0-42d1-83d9-52717fe7d9d3 response_code = 200 uri = /v2p
30572024-11-09T01:33:39.617ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63691
30582024-11-09T01:33:39.617ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30592024-11-09T01:33:39.670ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30602024-11-09T01:33:39.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 121532 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63691 req_id = d1763b97-ef8c-485c-b7d0-3e7db69efae4 response_code = 204 uri = /switch-ports
30612024-11-09T01:33:39.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63691 req_id = 0ca3d1f1-b12b-4d7d-bf07-1243f3c5f78c response_code = 200 uri = /network-bootstore-config
30622024-11-09T01:33:39.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40668
30632024-11-09T01:33:39.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40668 req_id = 42207e60-4688-4285-b39e-de989fba07b5 response_code = 200 uri = /vpc-routes
30642024-11-09T01:33:40.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41362
30652024-11-09T01:33:40.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41362 req_id = 6b5f4891-b225-443f-ba0b-e726dbb245df response_code = 200 uri = /vpc-routes
30662024-11-09T01:33:40.053ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
30672024-11-09T01:33:40.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40668 req_id = 86d021c7-1d7d-462d-a24f-da07279ae903 response_code = 204 uri = /eip-gateways
30682024-11-09T01:33:40.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40668 req_id = 7676bbde-98ca-4efd-bc4d-7263db7fba05 response_code = 204 uri = /vpc-routes
30692024-11-09T01:33:40.094ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
30702024-11-09T01:33:40.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41362 req_id = 07ec7e44-1f3a-479e-97bf-6aeb19669757 response_code = 204 uri = /eip-gateways
30712024-11-09T01:33:40.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62669
30722024-11-09T01:33:40.113ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30732024-11-09T01:33:40.164ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30742024-11-09T01:33:40.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112138 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62669 req_id = 8a83a4ce-c6c9-4ae7-aa92-6957e17bda8b response_code = 204 uri = /switch-ports
30752024-11-09T01:33:40.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36561
30762024-11-09T01:33:40.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52437
30772024-11-09T01:33:40.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52437 req_id = b3fa847a-4239-4675-9c9c-0673a04b12dd response_code = 200 uri = /v2p
30782024-11-09T01:33:40.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62669 req_id = 2a247653-4abd-4b82-9cd2-d60235224cd9 response_code = 200 uri = /network-bootstore-config
30792024-11-09T01:33:40.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 396 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41362 req_id = 287c4484-245b-4e41-9627-1cc6103119bf response_code = 204 uri = /vpc-routes
30802024-11-09T01:33:40.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36561 req_id = 5d771733-5121-40d8-a2e4-633569ff3946 response_code = 200 uri = /v2p
30812024-11-09T01:33:40.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50659
30822024-11-09T01:33:40.249ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30832024-11-09T01:33:40.293ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30842024-11-09T01:33:40.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104959 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50659 req_id = 91bcd3ac-cab7-4206-8d88-a2d325f84ab4 response_code = 204 uri = /switch-ports
30852024-11-09T01:33:40.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50659 req_id = ae394830-6e80-49b9-a6bf-aee90c0ff54b response_code = 200 uri = /network-bootstore-config
30862024-11-09T01:33:44.002ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30872024-11-09T01:33:44.002ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30882024-11-09T01:33:44.003ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30892024-11-09T01:33:44.004ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30902024-11-09T01:33:44.333ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30912024-11-09T01:33:44.334ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30922024-11-09T01:33:44.366ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30932024-11-09T01:33:44.373ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30942024-11-09T01:33:44.374ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30952024-11-09T01:33:44.374ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30962024-11-09T01:33:44.375ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30972024-11-09T01:33:44.375ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30982024-11-09T01:33:44.403ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
30992024-11-09T01:33:44.409ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31002024-11-09T01:33:44.414ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31012024-11-09T01:33:44.415ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31022024-11-09T01:33:44.416ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31032024-11-09T01:33:44.418ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31042024-11-09T01:33:51.119ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38116
31052024-11-09T01:33:51.120ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38116 req_id = b3ad94e0-55f8-4e82-a4b8-0fe36a915130 response_code = 200 uri = /baseboard
31062024-11-09T01:33:54.005ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31072024-11-09T01:33:54.006ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31082024-11-09T01:33:54.007ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31092024-11-09T01:33:54.008ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31102024-11-09T01:33:54.335ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31112024-11-09T01:33:54.336ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31122024-11-09T01:33:54.368ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31132024-11-09T01:33:54.374ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31142024-11-09T01:33:54.376ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31152024-11-09T01:33:54.377ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31162024-11-09T01:33:54.377ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31172024-11-09T01:33:54.378ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31182024-11-09T01:33:54.405ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31192024-11-09T01:33:54.411ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31202024-11-09T01:33:54.416ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31212024-11-09T01:33:54.416ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31222024-11-09T01:33:54.418ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31232024-11-09T01:33:54.419ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31242024-11-09T01:34:04.009ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31252024-11-09T01:34:04.009ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31262024-11-09T01:34:04.010ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31272024-11-09T01:34:04.011ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31282024-11-09T01:34:04.337ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31292024-11-09T01:34:04.338ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31302024-11-09T01:34:04.370ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31312024-11-09T01:34:04.376ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31322024-11-09T01:34:04.377ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31332024-11-09T01:34:04.378ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31342024-11-09T01:34:04.378ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31352024-11-09T01:34:04.379ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31362024-11-09T01:34:04.407ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31372024-11-09T01:34:04.413ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31382024-11-09T01:34:04.418ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31392024-11-09T01:34:04.419ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31402024-11-09T01:34:04.420ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31412024-11-09T01:34:04.421ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31422024-11-09T01:34:09.276ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63120
31432024-11-09T01:34:09.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63120 req_id = 895d291a-ffc3-4e58-a6ed-27eac400a66d response_code = 200 uri = /vpc-routes
31442024-11-09T01:34:09.317ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
31452024-11-09T01:34:09.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63120 req_id = 99426d16-b037-4111-95e9-d0369285170b response_code = 204 uri = /eip-gateways
31462024-11-09T01:34:09.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63120 req_id = 00408e59-33f6-4d51-89fb-c0386e2d902e response_code = 204 uri = /vpc-routes
31472024-11-09T01:34:09.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36000
31482024-11-09T01:34:09.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36000 req_id = f73b1846-1e4f-474d-8932-dbc65e7d6147 response_code = 200 uri = /v2p
31492024-11-09T01:34:09.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54739
31502024-11-09T01:34:09.439ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31512024-11-09T01:34:09.482ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31522024-11-09T01:34:09.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115610 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54739 req_id = 085ac0fa-4d32-4c6f-92f8-1b34caf8d53d response_code = 204 uri = /switch-ports
31532024-11-09T01:34:09.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54739 req_id = ed1b36a8-fb05-40c6-8ea1-302d0e319bbc response_code = 200 uri = /network-bootstore-config
31542024-11-09T01:34:09.731ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48764
31552024-11-09T01:34:09.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48764 req_id = 2d713103-f934-4ffc-b339-e40a053b36a0 response_code = 200 uri = /vpc-routes
31562024-11-09T01:34:09.772ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
31572024-11-09T01:34:09.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48764 req_id = 035d96e6-df26-4d3a-8fd7-bb0db8677efb response_code = 204 uri = /eip-gateways
31582024-11-09T01:34:09.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58071
31592024-11-09T01:34:09.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58071 req_id = e6ea1583-b04b-447f-8862-255024976316 response_code = 200 uri = /v2p
31602024-11-09T01:34:09.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48764 req_id = 98474fdd-7520-4940-b2d2-57f06bfff3fb response_code = 204 uri = /vpc-routes
31612024-11-09T01:34:09.848ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43875
31622024-11-09T01:34:09.848ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31632024-11-09T01:34:09.894ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31642024-11-09T01:34:09.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112973 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43875 req_id = b8d231eb-9fd5-4ae1-9175-6b86dca0e044 response_code = 204 uri = /switch-ports
31652024-11-09T01:34:09.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43875 req_id = 307589fc-db7d-4b54-9e67-15d9a52c5075 response_code = 200 uri = /network-bootstore-config
31662024-11-09T01:34:10.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35533
31672024-11-09T01:34:10.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35533 req_id = ac43977c-d675-41a1-9051-f0873da5f3dc response_code = 200 uri = /vpc-routes
31682024-11-09T01:34:10.018ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
31692024-11-09T01:34:10.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35533 req_id = 3b677e81-8d8b-4743-8f7b-11b88ad8c31b response_code = 204 uri = /eip-gateways
31702024-11-09T01:34:10.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35533 req_id = 8c0cbee6-c26b-4b17-9f00-62a57c9b5fed response_code = 204 uri = /vpc-routes
31712024-11-09T01:34:10.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41361
31722024-11-09T01:34:10.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41361 req_id = 38f6d2a2-dc87-481c-8add-d8c41263767f response_code = 200 uri = /v2p
31732024-11-09T01:34:10.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55905
31742024-11-09T01:34:10.116ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31752024-11-09T01:34:10.154ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31762024-11-09T01:34:10.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97976 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55905 req_id = 7e358fc8-dd97-4f61-ad4e-71a1d9a644fa response_code = 204 uri = /switch-ports
31772024-11-09T01:34:10.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55905 req_id = 1018a920-43dc-4eaa-829e-878dbd0cc4f9 response_code = 200 uri = /network-bootstore-config
31782024-11-09T01:34:14.012ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31792024-11-09T01:34:14.013ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31802024-11-09T01:34:14.014ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31812024-11-09T01:34:14.015ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31822024-11-09T01:34:14.339ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31832024-11-09T01:34:14.340ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31842024-11-09T01:34:14.373ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31852024-11-09T01:34:14.377ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31862024-11-09T01:34:14.379ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31872024-11-09T01:34:14.380ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31882024-11-09T01:34:14.381ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31892024-11-09T01:34:14.381ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31902024-11-09T01:34:14.408ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31912024-11-09T01:34:14.415ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31922024-11-09T01:34:14.420ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31932024-11-09T01:34:14.421ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31942024-11-09T01:34:14.422ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31952024-11-09T01:34:14.422ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31962024-11-09T01:34:21.153ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58513
31972024-11-09T01:34:21.154ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58513 req_id = 52477223-42b0-4d08-8671-1337725a7ecf response_code = 200 uri = /baseboard
31982024-11-09T01:34:24.015ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
31992024-11-09T01:34:24.016ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32002024-11-09T01:34:24.017ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32012024-11-09T01:34:24.018ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32022024-11-09T01:34:24.341ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32032024-11-09T01:34:24.342ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32042024-11-09T01:34:24.375ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32052024-11-09T01:34:24.379ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32062024-11-09T01:34:24.381ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32072024-11-09T01:34:24.382ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32082024-11-09T01:34:24.382ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32092024-11-09T01:34:24.383ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32102024-11-09T01:34:24.410ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32112024-11-09T01:34:24.416ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32122024-11-09T01:34:24.422ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32132024-11-09T01:34:24.423ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32142024-11-09T01:34:24.423ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32152024-11-09T01:34:24.424ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32162024-11-09T01:34:33.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61627
32172024-11-09T01:34:33.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61627 req_id = 876ea793-28c4-4404-b629-6f1c4894b760 response_code = 200 uri = /v2p
32182024-11-09T01:34:33.116ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(10318096) }
32192024-11-09T01:34:33.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 901 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61627 req_id = c64377b5-86e7-43c3-a402-061f7f164226 response_code = 204 uri = /v2p
32202024-11-09T01:34:33.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52309
32212024-11-09T01:34:33.267ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 5098310f-c0e2-474e-9d72-f01deb6c2a82, kind: Instance { id: 7cdfd0f3-3f79-42b0-9066-174287e507e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10318096), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5098310f-c0e2-474e-9d72-f01deb6c2a82, kind: Instance { id: 7cdfd0f3-3f79-42b0-9066-174287e507e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10318096), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5098310f-c0e2-474e-9d72-f01deb6c2a82, kind: Instance { id: 7cdfd0f3-3f79-42b0-9066-174287e507e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10318096), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(10318096))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5098310f-c0e2-474e-9d72-f01deb6c2a82, kind: Instance { id: 7cdfd0f3-3f79-42b0-9066-174287e507e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10318096), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-537a72e55e", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 9ae8eb3a-4042-4628-8d29-fe754eb295b4, read_only_parent: Some(Volume { block_size: 512, id: d99ec6cc-8819-4d44-953b-f8e3904c928d, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 701653fa-5954-4c7d-a2b8-552ccad9d12c, key: Some("k0YtfHKj/buZDXV9OA5J1brt/zaFmG70Kjw+78bx3QY="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::15]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 9ae8eb3a-4042-4628-8d29-fe754eb295b4, key: Some("HtmxK98oUH24d7wVBgW0QJKQmMEs+vfpIbkeiURVeEc="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19002", "[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::14]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-537a72e55e" }] }), cloud_init_bytes: Some(..) } instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 metadata = InstanceMetadata { silo_id: 539ccef2-8207-42b1-9e05-00e0a1387c35, project_id: 5e4035bd-8282-4789-b187-6ad917fc02e7 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-09T01:34:33.254804802Z }
32222024-11-09T01:34:33.267ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 migration_id = None propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
32232024-11-09T01:34:33.267ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 migration_id = None propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 5098310f-c0e2-474e-9d72-f01deb6c2a82, kind: Instance { id: 7cdfd0f3-3f79-42b0-9066-174287e507e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10318096), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5098310f-c0e2-474e-9d72-f01deb6c2a82, kind: Instance { id: 7cdfd0f3-3f79-42b0-9066-174287e507e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10318096), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5098310f-c0e2-474e-9d72-f01deb6c2a82, kind: Instance { id: 7cdfd0f3-3f79-42b0-9066-174287e507e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10318096), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(10318096))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5098310f-c0e2-474e-9d72-f01deb6c2a82, kind: Instance { id: 7cdfd0f3-3f79-42b0-9066-174287e507e1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10318096), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-537a72e55e", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 9ae8eb3a-4042-4628-8d29-fe754eb295b4, read_only_parent: Some(Volume { block_size: 512, id: d99ec6cc-8819-4d44-953b-f8e3904c928d, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 701653fa-5954-4c7d-a2b8-552ccad9d12c, key: Some("k0YtfHKj/buZDXV9OA5J1brt/zaFmG70Kjw+78bx3QY="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::15]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 9ae8eb3a-4042-4628-8d29-fe754eb295b4, key: Some("HtmxK98oUH24d7wVBgW0QJKQmMEs+vfpIbkeiURVeEc="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19002", "[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::14]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-537a72e55e" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-09T01:34:33.254804802Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
32242024-11-09T01:34:33.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 16881 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52309 req_id = 462334fc-dd0c-4535-8eae-9a0d4921ada4 response_code = 200 uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
32252024-11-09T01:34:33.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64837
32262024-11-09T01:34:33.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 460 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64837 req_id = 6d26f91e-a656-49c6-a62d-0455530d8ae2 response_code = 200 uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279/state
32272024-11-09T01:34:33.403ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 10318096 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
32282024-11-09T01:34:33.403ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
32292024-11-09T01:34:33.451ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279 file = illumos-utils/src/zone.rs:325 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
32302024-11-09T01:34:33.477ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279 file = illumos-utils/src/zone.rs:363 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
32312024-11-09T01:34:33.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39386
32322024-11-09T01:34:33.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39386 req_id = 091b05ab-9a9e-47c7-90a9-6286719887d1 response_code = 200 uri = /vpc-routes
32332024-11-09T01:34:33.536ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {5098310f-c0e2-474e-9d72-f01deb6c2a82: {10.151.2.175: {93d41d84-55e9-4770-92f8-fe888fd5677b}, 10.151.2.176: {93d41d84-55e9-4770-92f8-fe888fd5677b}}} }
32342024-11-09T01:34:34.018ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32352024-11-09T01:34:34.019ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32362024-11-09T01:34:34.020ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32372024-11-09T01:34:34.021ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32382024-11-09T01:34:34.344ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32392024-11-09T01:34:34.344ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32402024-11-09T01:34:34.377ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32412024-11-09T01:34:34.381ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32422024-11-09T01:34:34.383ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32432024-11-09T01:34:34.383ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32442024-11-09T01:34:34.384ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32452024-11-09T01:34:34.385ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32462024-11-09T01:34:34.412ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32472024-11-09T01:34:34.419ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32482024-11-09T01:34:34.425ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32492024-11-09T01:34:34.426ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32502024-11-09T01:34:34.426ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32512024-11-09T01:34:34.427ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
32522024-11-09T01:34:35.111ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
32532024-11-09T01:34:35.111ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 zone = oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279
32542024-11-09T01:34:35.312ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279") failed: Property not found. retry in 26.074695ms file = illumos-utils/src/svc.rs:36 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 zone = oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279
32552024-11-09T01:34:35.351ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279") failed: Property not found. retry in 74.577894ms file = illumos-utils/src/svc.rs:36 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 zone = oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279
32562024-11-09T01:34:35.445ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279") failed: Property not found. retry in 243.971105ms file = illumos-utils/src/svc.rs:36 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 zone = oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279
32572024-11-09T01:34:35.703ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279") failed: Property not found. retry in 358.96173ms file = illumos-utils/src/svc.rs:36 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 zone = oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279
32582024-11-09T01:34:36.083ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279") failed: Property not found. retry in 1.020480951s file = illumos-utils/src/svc.rs:36 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 zone = oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279
32592024-11-09T01:34:37.116ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279") failed: Property not found. retry in 1.379986455s file = illumos-utils/src/svc.rs:36 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 zone = oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279
32602024-11-09T01:34:38.508ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279") failed: Property not found. retry in 1.118370131s file = illumos-utils/src/svc.rs:36 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 zone = oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279
32612024-11-09T01:34:39.429ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41087
32622024-11-09T01:34:39.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41087 req_id = 1ee73acd-bd81-4cd1-a861-8ac5b233064e response_code = 200 uri = /vpc-routes
32632024-11-09T01:34:39.565ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41063
32642024-11-09T01:34:39.644ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279") failed: Property not found. retry in 893.747105ms file = illumos-utils/src/svc.rs:36 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 zone = oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279
32652024-11-09T01:34:39.644ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {5098310f-c0e2-474e-9d72-f01deb6c2a82: {10.151.2.175: {93d41d84-55e9-4770-92f8-fe888fd5677b}, 10.151.2.176: {93d41d84-55e9-4770-92f8-fe888fd5677b}}} }
32662024-11-09T01:34:39.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41087 req_id = 47926452-bf29-4214-9f52-9ab83373863f response_code = 204 uri = /eip-gateways
32672024-11-09T01:34:39.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59626
32682024-11-09T01:34:39.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59626 req_id = 2d5ea779-6e64-490f-aacb-40c45007e360 response_code = 200 uri = /v2p
32692024-11-09T01:34:39.773ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51694
32702024-11-09T01:34:39.773ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32712024-11-09T01:34:39.842ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32722024-11-09T01:34:39.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 163168 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51694 req_id = bb273773-2889-4a2e-9072-c4cdc4f88703 response_code = 204 uri = /switch-ports
32732024-11-09T01:34:39.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48123
32742024-11-09T01:34:39.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59461
32752024-11-09T01:34:39.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51694 req_id = 0657f99f-3b1f-4cc4-8304-d28985fbed89 response_code = 200 uri = /network-bootstore-config
32762024-11-09T01:34:39.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59461 req_id = 9c2181c0-ae3f-4d16-a635-de5ac31677c3 response_code = 200 uri = /vpc-routes
32772024-11-09T01:34:39.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 678 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41087 req_id = 222fb426-ee2e-4919-a7c9-37b11333a37d response_code = 204 uri = /vpc-routes
32782024-11-09T01:34:39.981ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {5098310f-c0e2-474e-9d72-f01deb6c2a82: {10.151.2.176: {93d41d84-55e9-4770-92f8-fe888fd5677b}, 10.151.2.175: {93d41d84-55e9-4770-92f8-fe888fd5677b}}} }
32792024-11-09T01:34:39.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59461 req_id = 9935e699-4e94-4640-9756-736f173db724 response_code = 204 uri = /eip-gateways
32802024-11-09T01:34:39.993ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34894
32812024-11-09T01:34:40.075ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58127
32822024-11-09T01:34:40.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58127 req_id = 5eb02f50-8b1c-4d55-97c8-bdc03a242bd0 response_code = 200 uri = /v2p
32832024-11-09T01:34:40.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58493
32842024-11-09T01:34:40.092ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32852024-11-09T01:34:40.143ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32862024-11-09T01:34:40.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122959 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58493 req_id = 37b97270-cb97-483c-9376-900ea1ac1f16 response_code = 204 uri = /switch-ports
32872024-11-09T01:34:40.215ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47415
32882024-11-09T01:34:40.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47415 req_id = a6778213-54d7-4bc2-98f1-557688af4879 response_code = 200 uri = /v2p
32892024-11-09T01:34:40.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58493 req_id = 7877bf33-8c54-434b-b2a3-5f8c756c7970 response_code = 200 uri = /network-bootstore-config
32902024-11-09T01:34:40.216ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: a54938ce-5828-445e-a9a5-ebdb162c56bc, version: 3 } old_vers = RouterVersion { router_id: a54938ce-5828-445e-a9a5-ebdb162c56bc, version: 3 } subnet = RouterId { vni: Vni(10318096), kind: System }
32912024-11-09T01:34:40.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 473 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59461 req_id = b5dd1bde-de4d-498c-b5cb-ef2d5a096c0e response_code = 204 uri = /vpc-routes
32922024-11-09T01:34:40.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61903
32932024-11-09T01:34:40.286ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32942024-11-09T01:34:40.334ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32952024-11-09T01:34:40.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113331 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61903 req_id = b9757e76-42a4-425d-a5c3-c1e17ab7d3e5 response_code = 204 uri = /switch-ports
32962024-11-09T01:34:40.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61903 req_id = d5988255-c368-488b-812b-914c197eab9d response_code = 200 uri = /network-bootstore-config
32972024-11-09T01:34:40.572ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279 file = sled-agent/src/instance.rs:1787 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
32982024-11-09T01:34:40.582ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279") failed: Property not found. retry in 57.918163ms file = illumos-utils/src/svc.rs:36 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
32992024-11-09T01:34:40.651ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279") failed: Property not found. retry in 108.964906ms file = illumos-utils/src/svc.rs:36 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
33002024-11-09T01:34:40.774ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279") failed: Property not found. retry in 202.780722ms file = illumos-utils/src/svc.rs:36 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
33012024-11-09T01:34:40.989ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
33022024-11-09T01:34:41.027ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
33032024-11-09T01:34:41.164ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
33042024-11-09T01:34:41.165ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1230 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33052024-11-09T01:34:41.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1171681 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34894 req_id = 253fd39f-9c56-427f-abb8-c42941c9aba5 response_code = 200 uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279/state
33062024-11-09T01:34:41.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1600340 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41063 req_id = efa47b62-a376-4dd0-8a39-b2e33b73e7a4 response_code = 200 uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279/state
33072024-11-09T01:34:41.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7630442 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39386 req_id = 9ce9f75e-ebed-48e4-b698-550ce1675c79 response_code = 204 uri = /eip-gateways
33082024-11-09T01:34:41.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1228900 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48123 req_id = b3fdb9b6-a3c6-4a7e-aafd-ff3514990430 response_code = 200 uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279/state
33092024-11-09T01:34:41.166ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-09T01:34:41.166065012Z } file = sled-agent/src/instance.rs:780 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
33102024-11-09T01:34:41.168ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-09T01:34:41.166065012Z } propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
33112024-11-09T01:34:41.168ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-09T01:34:41.166065012Z }, migration_in: None, migration_out: None }
33122024-11-09T01:34:41.183ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-09T01:34:41.183469126Z } file = sled-agent/src/instance.rs:780 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
33132024-11-09T01:34:41.183ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-09T01:34:41.183469126Z } propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
33142024-11-09T01:34:41.183ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-09T01:34:41.183469126Z }, migration_in: None, migration_out: None }
33152024-11-09T01:34:41.287ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: a54938ce-5828-445e-a9a5-ebdb162c56bc, version: 3 } old_vers = RouterVersion { router_id: a54938ce-5828-445e-a9a5-ebdb162c56bc, version: 3 } subnet = RouterId { vni: Vni(10318096), kind: System }
33162024-11-09T01:34:41.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39386 req_id = 796b53bf-241c-4503-9c79-61623fab67da response_code = 204 uri = /vpc-routes
33172024-11-09T01:34:41.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65378
33182024-11-09T01:34:41.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65378 req_id = 185eb46e-cae7-4ed5-aef4-01adda79ea46 response_code = 200 uri = /vpc-routes
33192024-11-09T01:34:41.342ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {5098310f-c0e2-474e-9d72-f01deb6c2a82: {10.151.2.175: {93d41d84-55e9-4770-92f8-fe888fd5677b}, 10.151.2.176: {93d41d84-55e9-4770-92f8-fe888fd5677b}}} }
33202024-11-09T01:34:41.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65378 req_id = 0fafecc9-e113-4c45-bee9-8cb7f274a2b9 response_code = 204 uri = /eip-gateways
33212024-11-09T01:34:41.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65378 req_id = 1f5993b1-a0e9-4560-adbb-224ea9288d52 response_code = 204 uri = /vpc-routes
33222024-11-09T01:34:44.023ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33232024-11-09T01:34:44.024ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33242024-11-09T01:34:44.025ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33252024-11-09T01:34:44.026ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33262024-11-09T01:34:44.345ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33272024-11-09T01:34:44.346ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33282024-11-09T01:34:44.379ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33292024-11-09T01:34:44.384ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33302024-11-09T01:34:44.384ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33312024-11-09T01:34:44.385ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33322024-11-09T01:34:44.386ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33332024-11-09T01:34:44.387ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33342024-11-09T01:34:44.413ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33352024-11-09T01:34:44.421ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33362024-11-09T01:34:44.426ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33372024-11-09T01:34:44.427ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33382024-11-09T01:34:44.428ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33392024-11-09T01:34:44.428ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33402024-11-09T01:34:51.186ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38123
33412024-11-09T01:34:51.186ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38123 req_id = 22db14e8-cce5-424f-992f-fb747d7dd577 response_code = 200 uri = /baseboard
33422024-11-09T01:34:51.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54267
33432024-11-09T01:34:51.291ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-09T01:34:51.291382118Z } file = sled-agent/src/instance.rs:780 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
33442024-11-09T01:34:51.291ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-09T01:34:51.291382118Z } propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
33452024-11-09T01:34:51.291ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-09T01:34:51.291382118Z }, migration_in: None, migration_out: None }
33462024-11-09T01:34:51.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 664 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54267 req_id = 16150eee-010b-428a-adb8-95f45c998a51 response_code = 200 uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279/state
33472024-11-09T01:34:51.335ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-09T01:34:51.335061016Z } file = sled-agent/src/instance.rs:780 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
33482024-11-09T01:34:51.335ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-09T01:34:51.335061016Z } propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
33492024-11-09T01:34:51.335ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
33502024-11-09T01:34:51.335ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
33512024-11-09T01:34:51.335ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
33522024-11-09T01:34:51.335ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/8d8ef7b1-4af4-4c69-9e3f-98ca7b356569/debug/bundle/zone", "/pool/int/f925765a-5a42-4a3d-aa53-e9481c784b20/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/ab413033-915c-42e6-846f-3f01a7447749/crypt/debug", "/pool/ext/1f0e3af0-a7d2-464f-9192-4fe81acc94c1/crypt/debug", "/pool/ext/dfa112e2-c0df-4b06-b74f-0a27df3ed293/crypt/debug", "/pool/ext/ff1cdd93-8ce7-4ee1-845c-a77798315216/crypt/debug", "/pool/ext/fb3197ce-1650-4560-94ee-2bc866b44b0e/crypt/debug", "/pool/ext/3b61ae58-143a-47f2-a80d-e4aeb0c981fa/crypt/debug", "/pool/ext/3ddfa1e2-6686-49f9-839e-ea29e37a9969/crypt/debug", "/pool/ext/429a71c0-de37-4c29-9517-d34e0fdea40d/crypt/debug", "/pool/ext/bf89547e-f293-4d7a-96c8-740a254cce2e/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279
33532024-11-09T01:34:51.335ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 8120396938935371666 n_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33542024-11-09T01:34:51.335ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 11427485140051275066 n_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33552024-11-09T01:34:52.002ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279", bundle_id: dd84441d-3a9e-4ec8-add6-1f641e7a793b }, time_created: 2024-11-09T01:34:51.335804894Z, version: 0, cause: TerminatedInstance }
33562024-11-09T01:34:52.003ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_5af420a0-b4b5-4661-bc1a-e38adaa39279 file = sled-agent/src/instance.rs:1032 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
33572024-11-09T01:34:53.781ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
33582024-11-09T01:34:53.800ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(10318096), kind: System }
33592024-11-09T01:34:53.800ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(10318096), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
33602024-11-09T01:34:53.801ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-09T01:34:53.801262893Z }, migration_in: None, migration_out: None }
33612024-11-09T01:34:53.839ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-09T01:34:53.801262893Z }, migration_in: None, migration_out: None }
33622024-11-09T01:34:53.842ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
33632024-11-09T01:34:54.027ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33642024-11-09T01:34:54.028ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33652024-11-09T01:34:54.028ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33662024-11-09T01:34:54.030ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33672024-11-09T01:34:54.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59285
33682024-11-09T01:34:54.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59285 req_id = 2d25649e-0b55-4332-baef-d136e9127bda response_code = 200 uri = /vpc-routes
33692024-11-09T01:34:54.347ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33702024-11-09T01:34:54.348ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33712024-11-09T01:34:54.380ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33722024-11-09T01:34:54.385ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33732024-11-09T01:34:54.386ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33742024-11-09T01:34:54.387ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33752024-11-09T01:34:54.387ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33762024-11-09T01:34:54.389ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33772024-11-09T01:34:54.394ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
33782024-11-09T01:34:54.394ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1230 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33792024-11-09T01:34:54.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59285 req_id = 28b9ca36-221a-4f32-a5cb-030852816833 response_code = 204 uri = /eip-gateways
33802024-11-09T01:34:54.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59285 req_id = 80efa8de-8146-4e34-a33f-54c2e50fb0b4 response_code = 204 uri = /vpc-routes
33812024-11-09T01:34:54.415ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33822024-11-09T01:34:54.423ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33832024-11-09T01:34:54.428ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33842024-11-09T01:34:54.429ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33852024-11-09T01:34:54.430ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33862024-11-09T01:34:54.431ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
33872024-11-09T01:34:54.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52313
33882024-11-09T01:34:54.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52313 req_id = ed0126a2-be89-4652-ae8d-cb9704b41402 response_code = 200 uri = /v2p
33892024-11-09T01:34:54.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36793
33902024-11-09T01:34:54.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36793 req_id = 2ec02c7b-fa3b-4be9-b0d9-95f17b08ee09 response_code = 200 uri = /v2p
33912024-11-09T01:34:54.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39678
33922024-11-09T01:34:54.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39678 req_id = 46df3277-b766-41b7-bcd2-19549c58e7f0 response_code = 200 uri = /vpc-routes
33932024-11-09T01:34:54.678ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
33942024-11-09T01:34:54.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39678 req_id = 4a79e2db-7740-4b41-a61b-cbc4284d1491 response_code = 204 uri = /eip-gateways
33952024-11-09T01:34:54.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39678 req_id = 34ec05e1-8fb5-40af-949a-3f2a75fa52cf response_code = 204 uri = /vpc-routes
33962024-11-09T01:34:55.359ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39151
33972024-11-09T01:34:55.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39151 req_id = e0e16b84-d9bb-41d6-9ea1-b678c43ca66b response_code = 200 uri = /vpc-routes
33982024-11-09T01:34:55.399ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1204 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 values = ExternalIpGatewayMap { mappings: {} }
33992024-11-09T01:34:55.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39151 req_id = cc0f7b5c-f931-47fc-a815-ce79c85f7eb2 response_code = 204 uri = /eip-gateways
34002024-11-09T01:34:55.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39151 req_id = 867a9f4b-e74f-472e-843b-05e32020fa85 response_code = 204 uri = /vpc-routes