Max level shown:
1 [ Nov 19 05:50:42 Enabled. ]
2 [ Nov 19 05:50:42 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 19 05:50:42 Method "start" exited with status 0. ]
4 [ Nov 19 05:50:42 Rereading configuration. ]
5 [ Nov 19 05:50:42 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-19T05:50:42.115ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-19T05:50:42.116ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-19T05:50:42.169ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-19T05:50:42.169ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-19T05:50:42.285ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-19T05:50:42.294ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-19T05:50:42.302ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-19T05:50:42.904ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-11-19T05:50:43.044ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-19T05:50:43.044ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-19T05:50:43.044ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-19T05:50:43.044ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-19T05:50:43.044ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-11-19T05:50:43.044ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-11-19T05:50:43.047ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-19T05:50:43.047ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-19T05:50:43.047ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-19T05:50:43.047ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-19T05:50:43.047ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-19T05:50:43.047ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-19T05:50:43.047ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-11-19T05:50:43.047ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-19T05:50:43.047ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-19T05:50:43.059ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-19T05:50:43.059ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = e96bca9b-11cd-4c01-9e26-77ae8318b28c (zpool)
322024-11-19T05:50:43.158ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e96bca9b-11cd-4c01-9e26-77ae8318b28c (zpool), kind: Internal }
332024-11-19T05:50:43.634ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-11-19T05:50:43.634ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-19T05:50:43.634ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-19T05:50:43.634ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-19T05:50:43.634ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-11-19T05:50:43.634ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-19T05:50:43.634ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-19T05:50:43.642ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-19T05:50:43.642ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 309add57-857d-42cd-8f12-8351d275a791 (zpool)
422024-11-19T05:50:43.732ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 309add57-857d-42cd-8f12-8351d275a791 (zpool), kind: Internal }
432024-11-19T05:50:44.208ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-19T05:50:44.208ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e96bca9b-11cd-4c01-9e26-77ae8318b28c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 309add57-857d-42cd-8f12-8351d275a791 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-19T05:50:44.208ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-11-19T05:50:44.208ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
472024-11-19T05:50:44.208ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
482024-11-19T05:50:44.208ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
492024-11-19T05:50:44.208ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-19T05:50:44.208ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e96bca9b-11cd-4c01-9e26-77ae8318b28c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 309add57-857d-42cd-8f12-8351d275a791 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-11-19T05:50:44.208ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-11-19T05:50:44.208ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
532024-11-19T05:50:44.208ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
542024-11-19T05:50:44.208ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-11-19T05:50:44.208ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-19T05:50:44.208ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e96bca9b-11cd-4c01-9e26-77ae8318b28c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 309add57-857d-42cd-8f12-8351d275a791 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-11-19T05:50:44.209ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
582024-11-19T05:50:44.209ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
592024-11-19T05:50:44.209ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
602024-11-19T05:50:44.209ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612024-11-19T05:50:44.209ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-19T05:50:44.209ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
632024-11-19T05:50:44.209ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e96bca9b-11cd-4c01-9e26-77ae8318b28c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 309add57-857d-42cd-8f12-8351d275a791 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
642024-11-19T05:50:44.209ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652024-11-19T05:50:44.209ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-11-19T05:50:44.209ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-11-19T05:50:44.209ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-19T05:50:44.209ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e96bca9b-11cd-4c01-9e26-77ae8318b28c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 309add57-857d-42cd-8f12-8351d275a791 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-11-19T05:50:44.209ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
702024-11-19T05:50:44.209ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
712024-11-19T05:50:44.209ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
722024-11-19T05:50:44.209ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
732024-11-19T05:50:44.209ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-19T05:50:44.209ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e96bca9b-11cd-4c01-9e26-77ae8318b28c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 309add57-857d-42cd-8f12-8351d275a791 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-11-19T05:50:44.209ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-11-19T05:50:44.209ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-11-19T05:50:44.209ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-11-19T05:50:44.209ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-11-19T05:50:44.209ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-11-19T05:50:44.209ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e96bca9b-11cd-4c01-9e26-77ae8318b28c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 309add57-857d-42cd-8f12-8351d275a791 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-11-19T05:50:44.209ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822024-11-19T05:50:44.209ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832024-11-19T05:50:44.209ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
842024-11-19T05:50:44.209ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-11-19T05:50:44.209ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-11-19T05:50:44.209ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
872024-11-19T05:50:44.209ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-11-19T05:50:44.209ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e96bca9b-11cd-4c01-9e26-77ae8318b28c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 309add57-857d-42cd-8f12-8351d275a791 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892024-11-19T05:50:44.209ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902024-11-19T05:50:44.209ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912024-11-19T05:50:44.209ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-11-19T05:50:44.209ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
932024-11-19T05:50:44.209ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-11-19T05:50:44.209ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e96bca9b-11cd-4c01-9e26-77ae8318b28c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 309add57-857d-42cd-8f12-8351d275a791 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-11-19T05:50:44.209ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-11-19T05:50:44.209ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-11-19T05:50:44.209ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-11-19T05:50:44.209ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-11-19T05:50:44.209ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1002024-11-19T05:50:44.209ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e96bca9b-11cd-4c01-9e26-77ae8318b28c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 309add57-857d-42cd-8f12-8351d275a791 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012024-11-19T05:50:44.209ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022024-11-19T05:50:44.209ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032024-11-19T05:50:44.209ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-11-19T05:50:44.209ZINFOSledAgent (bootstore): No ledger in /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-11-19T05:50:44.209ZINFOSledAgent (bootstore): No ledger in /pool/int/309add57-857d-42cd-8f12-8351d275a791/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-11-19T05:50:44.209ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-11-19T05:50:44.209ZINFOSledAgent (bootstore): No ledger in /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-11-19T05:50:44.209ZINFOSledAgent (bootstore): No ledger in /pool/int/309add57-857d-42cd-8f12-8351d275a791/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-11-19T05:50:44.209ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-11-19T05:50:44.209ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-19T05:50:44.209ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-19T05:50:44.220ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1132024-11-19T05:50:44.220ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 3274, tv_nsec: 436221577 } time_to_next_cleanup = 599.999934989s
1142024-11-19T05:50:44.220ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1152024-11-19T05:50:44.220ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-11-19T05:50:44.223ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-11-19T05:50:44.223ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-11-19T05:50:44.223ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-11-19T05:50:44.225ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-11-19T05:50:44.225ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1200
1212024-11-19T05:50:44.225ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-19T05:50:44.225ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-11-19T05:50:44.225ZINFOSledAgent (RSS): No ledger in /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-11-19T05:50:44.225ZINFOSledAgent (RSS): No ledger in /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-11-19T05:50:44.225ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1263
1262024-11-19T05:50:44.225ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1272024-11-19T05:50:44.225ZINFOSledAgent (RSS): No ledger in /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-11-19T05:50:44.225ZINFOSledAgent (RSS): No ledger in /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-11-19T05:50:44.225ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1305
1302024-11-19T05:50:44.225ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-19T05:50:44.225ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-19T05:50:44.225ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1332024-11-19T05:50:44.225ZINFOSledAgent (RSS): Writing ledger to /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-11-19T05:50:44.226ZINFOSledAgent (RSS): Writing ledger to /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-11-19T05:50:44.226ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: f37e9a5a-e62c-4f4c-b823-2a838c617a9c, sleds: { [fdb0:18c0:4d0d:9fb2::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 176942d8-6f67-414d-8390-55e992dfe909 (sled), rack_id: f37e9a5a-e62c-4f4c-b823-2a838c617a9c, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-11-19T05:50:44.226ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1339
1372024-11-19T05:50:44.226ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1382024-11-19T05:50:44.226ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1392024-11-19T05:50:44.226ZINFOSledAgent (bootstore): Writing ledger to /pool/int/309add57-857d-42cd-8f12-8351d275a791/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1402024-11-19T05:50:44.226ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1412024-11-19T05:50:44.227ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 176942d8-6f67-414d-8390-55e992dfe909 (sled), rack_id: f37e9a5a-e62c-4f4c-b823-2a838c617a9c, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1422024-11-19T05:50:44.227ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1432024-11-19T05:50:44.227ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1442024-11-19T05:50:44.232ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1452024-11-19T05:50:44.237ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-11-19T05:50:44.237ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-11-19T05:50:44.241ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1482024-11-19T05:50:44.242ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1492024-11-19T05:50:44.242ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:41301
1502024-11-19T05:50:44.242ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 176942d8-6f67-414d-8390-55e992dfe909 (sled), rack_id: f37e9a5a-e62c-4f4c-b823-2a838c617a9c, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1512024-11-19T05:50:44.242ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1522024-11-19T05:50:44.242ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532024-11-19T05:50:44.242ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542024-11-19T05:50:44.242ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1552024-11-19T05:50:44.242ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1562024-11-19T05:50:44.242ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1572024-11-19T05:50:44.242ZINFOSledAgent (StorageManager): No ledger in /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1582024-11-19T05:50:44.242ZINFOSledAgent (StorageManager): No ledger in /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1592024-11-19T05:50:44.242ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1602024-11-19T05:50:44.242ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1612024-11-19T05:50:44.242ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1622024-11-19T05:50:44.242ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1632024-11-19T05:50:44.242ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1642024-11-19T05:50:44.257ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1652024-11-19T05:50:44.277ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1662024-11-19T05:50:44.294ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1672024-11-19T05:50:44.304ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:408 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
1682024-11-19T05:50:44.304ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1692024-11-19T05:50:44.304ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:420 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
1702024-11-19T05:50:44.304ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1712024-11-19T05:50:44.307ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 66.042525ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "43b17277-8e9d-483c-96da-73ec6de05d39", "content-length": "124", "date": "Tue, 19 Nov 2024 05:50:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "43b17277-8e9d-483c-96da-73ec6de05d39" } file = clients/ddm-admin-client/src/lib.rs:177
1722024-11-19T05:50:44.317ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_e96bca9b-11cd-4c01-9e26-77ae8318b28c/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1732024-11-19T05:50:44.342ZINFOSledAgent: successfully created encrypted zvol: name="oxi_e96bca9b-11cd-4c01-9e26-77ae8318b28c/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1742024-11-19T05:50:44.342ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_e96bca9b-11cd-4c01-9e26-77ae8318b28c/swap" file = sled-agent/src/swap_device.rs:96
1752024-11-19T05:50:44.347ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:435 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
1762024-11-19T05:50:44.347ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1772024-11-19T05:50:44.347ZINFOSledAgent (BackingFs): Ensuring dataset oxi_e96bca9b-11cd-4c01-9e26-77ae8318b28c/backing/fmd file = sled-agent/src/backing_fs.rs:138
1782024-11-19T05:50:44.374ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1792024-11-19T05:50:44.377ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 98.369385ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1042ad3e-f69d-4c9c-ba44-6fc3bbff0aea", "content-length": "124", "date": "Tue, 19 Nov 2024 05:50:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1042ad3e-f69d-4c9c-ba44-6fc3bbff0aea" } file = clients/ddm-admin-client/src/lib.rs:177
1802024-11-19T05:50:44.434ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1812024-11-19T05:50:44.476ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-11-19T05:50:44.476ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 104.376589ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "61334f15-c020-4a4b-902e-5cb18e559b3e", "content-length": "124", "date": "Tue, 19 Nov 2024 05:50:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "61334f15-c020-4a4b-902e-5cb18e559b3e" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-11-19T05:50:44.583ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1842024-11-19T05:50:44.583ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 146.456856ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4569504c-2da7-4175-a268-2f8363107794", "content-length": "124", "date": "Tue, 19 Nov 2024 05:50:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4569504c-2da7-4175-a268-2f8363107794" } file = clients/ddm-admin-client/src/lib.rs:177
1852024-11-19T05:50:44.653ZINFOSledAgent (BackingFs): Mounting oxi_e96bca9b-11cd-4c01-9e26-77ae8318b28c/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1862024-11-19T05:50:44.666ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1872024-11-19T05:50:44.666ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1882024-11-19T05:50:44.666ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1892024-11-19T05:50:44.666ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1902024-11-19T05:50:44.730ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-11-19T05:50:44.730ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 171.726042ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ad0ff89a-eb9f-4340-8379-631d35e1bb00", "content-length": "124", "date": "Tue, 19 Nov 2024 05:50:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ad0ff89a-eb9f-4340-8379-631d35e1bb00" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-11-19T05:50:44.903ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-11-19T05:50:44.907ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 300.042325ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ed9015ae-7b23-4667-a6a4-c9d431eaad4e", "content-length": "124", "date": "Tue, 19 Nov 2024 05:50:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ed9015ae-7b23-4667-a6a4-c9d431eaad4e" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-11-19T05:50:45.207ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1952024-11-19T05:50:45.208ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 417.614589ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2743864b-5f8d-40d1-a784-b8b57c389a82", "content-length": "124", "date": "Tue, 19 Nov 2024 05:50:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2743864b-5f8d-40d1-a784-b8b57c389a82" } file = clients/ddm-admin-client/src/lib.rs:177
1962024-11-19T05:50:45.396ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
1972024-11-19T05:50:45.401ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:42519 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
1982024-11-19T05:50:45.401ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
1992024-11-19T05:50:45.401ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:42519 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 176942d8-6f67-414d-8390-55e992dfe909 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
2002024-11-19T05:50:45.402ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 244.674671ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
2012024-11-19T05:50:45.403ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
2022024-11-19T05:50:45.403ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
2032024-11-19T05:50:45.403ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2042024-11-19T05:50:45.403ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2052024-11-19T05:50:45.626ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2062024-11-19T05:50:45.649ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 457.673521ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
2072024-11-19T05:50:46.108ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.470175967s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
2082024-11-19T05:50:47.579ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.282420415s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
2092024-11-19T05:50:47.943ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2102024-11-19T05:50:47.943ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2112024-11-19T05:50:47.943ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2122024-11-19T05:50:47.943ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2132024-11-19T05:50:47.944ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2142024-11-19T05:50:47.944ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2152024-11-19T05:50:47.945ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2162024-11-19T05:50:47.947ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2172024-11-19T05:50:47.947ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='bc732c40-7477-46ff-8e17-70606671989c'/> <propval type="astring" name="rack_id" value='f37e9a5a-e62c-4f4c-b823-2a838c617a9c'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe1d:6ef5'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='f37e9a5a-e62c-4f4c-b823-2a838c617a9c'/> <propval type="astring" name="sled_id" value='176942d8-6f67-414d-8390-55e992dfe909'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='176942d8-6f67-414d-8390-55e992dfe909'/> <propval type="astring" name="rack_uuid" value='f37e9a5a-e62c-4f4c-b823-2a838c617a9c'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='176942d8-6f67-414d-8390-55e992dfe909'/> <propval type="astring" name="rack_uuid" value='f37e9a5a-e62c-4f4c-b823-2a838c617a9c'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2182024-11-19T05:50:47.947ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2192024-11-19T05:50:48.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 33.953953ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-11-19T05:50:48.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 74.621434ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-11-19T05:50:48.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 219.904125ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-11-19T05:50:48.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 363.007089ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-11-19T05:50:49.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.19872289s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-11-19T05:50:49.864ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.598695507s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
2252024-11-19T05:50:50.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.086594273s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-19T05:50:51.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 850.014937ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-11-19T05:50:52.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 880.625703ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282024-11-19T05:50:53.939ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/176942d8-6f67-414d-8390-55e992dfe909) file = sled-agent/src/nexus.rs:527 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
2292024-11-19T05:50:53.969ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2302024-11-19T05:50:53.969ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
2312024-11-19T05:50:53.970ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2322024-11-19T05:50:53.970ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2332024-11-19T05:50:53.970ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2342024-11-19T05:50:53.970ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352024-11-19T05:50:53.970ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2362024-11-19T05:50:53.970ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2372024-11-19T05:50:53.970ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2382024-11-19T05:50:53.970ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2392024-11-19T05:50:53.970ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:41301
2402024-11-19T05:50:54.145ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2412024-11-19T05:50:54.146ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2422024-11-19T05:50:54.146ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2432024-11-19T05:50:54.146ZINFOSledAgent (RSS): No ledger in /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2442024-11-19T05:50:54.146ZINFOSledAgent (RSS): No ledger in /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2452024-11-19T05:50:54.146ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2462024-11-19T05:50:54.146ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2472024-11-19T05:50:54.146ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2482024-11-19T05:50:54.146ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2492024-11-19T05:50:54.151ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2502024-11-19T05:50:54.151ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2512024-11-19T05:50:54.151ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2522024-11-19T05:50:54.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41615
2532024-11-19T05:50:54.409ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2542024-11-19T05:50:54.409ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2552024-11-19T05:50:54.409ZINFOSledAgent (ServiceManager): No ledger in /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/omicron-zones.json file = common/src/ledger.rs:188
2562024-11-19T05:50:54.409ZINFOSledAgent (ServiceManager): No ledger in /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/omicron-zones.json file = common/src/ledger.rs:188
2572024-11-19T05:50:54.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 351 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41615 req_id = 9e5fda3f-699d-4653-8d8b-163ef8e5b18e response_code = 200 uri = /inventory
2582024-11-19T05:50:54.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61562
2592024-11-19T05:50:54.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61562 req_id = 65ef1300-839c-402a-bb79-00e461bf60d3 response_code = 200 uri = /sled-role
2602024-11-19T05:50:54.442ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2612024-11-19T05:50:54.442ZINFOSledAgent (RSS): Writing ledger to /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2622024-11-19T05:50:54.443ZINFOSledAgent (RSS): Writing ledger to /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2632024-11-19T05:50:54.443ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:980
2642024-11-19T05:50:54.464ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 6.274802026s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
2652024-11-19T05:50:54.472ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 89978a87-5588-465e-9e8f-0c12bb9a44b5, pool_id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 0931ee87-b255-4f34-a150-86be86aba98e, pool_id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: faf398af-b603-4a0b-9266-50512dd5e9e5, pool_id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: a9a6aa1d-f8fc-4451-b63e-74bf743a3faf, pool_id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 20772537-e740-40b5-ac32-fb4047074111, pool_id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 5823cede-30b2-419a-8eb0-2156642acace, pool_id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 07004c85-3c19-437d-b63b-3baec42b2cdb, pool_id: 2d68dcb6-83b9-430c-b8d8-fa955e9efd1b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 7781e378-bbc7-4370-97c0-7a06e94ae4ec, pool_id: b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: cc4e0e00-a1f3-4ae3-863e-760fecf9efdc, pool_id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool) }] } file = sled-agent/src/rack_setup/service.rs:382 sled_address = [fd00:1122:3344:101::1]:12345
2662024-11-19T05:50:54.472ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51911
2672024-11-19T05:50:54.472ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:884 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
2682024-11-19T05:50:54.472ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 89978a87-5588-465e-9e8f-0c12bb9a44b5, pool_id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 0931ee87-b255-4f34-a150-86be86aba98e, pool_id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: faf398af-b603-4a0b-9266-50512dd5e9e5, pool_id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: a9a6aa1d-f8fc-4451-b63e-74bf743a3faf, pool_id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 20772537-e740-40b5-ac32-fb4047074111, pool_id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 5823cede-30b2-419a-8eb0-2156642acace, pool_id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 07004c85-3c19-437d-b63b-3baec42b2cdb, pool_id: 2d68dcb6-83b9-430c-b8d8-fa955e9efd1b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 7781e378-bbc7-4370-97c0-7a06e94ae4ec, pool_id: b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: cc4e0e00-a1f3-4ae3-863e-760fecf9efdc, pool_id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2692024-11-19T05:50:54.472ZINFOSledAgent (StorageManager): No ledger in /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2702024-11-19T05:50:54.472ZINFOSledAgent (StorageManager): No ledger in /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2712024-11-19T05:50:54.472ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2722024-11-19T05:50:54.472ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2732024-11-19T05:50:54.472ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2742024-11-19T05:50:54.472ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2752024-11-19T05:50:54.472ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2762024-11-19T05:50:54.647ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2772024-11-19T05:50:54.647ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 8f726703-f78a-4246-88d2-b12195677e7c (zpool)
2782024-11-19T05:50:55.083ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/176942d8-6f67-414d-8390-55e992dfe909) file = sled-agent/src/probe_manager.rs:231 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
2792024-11-19T05:50:55.546ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
2802024-11-19T05:50:55.547ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5024699827489478459 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
2812024-11-19T05:50:55.547ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14012425544086727305 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
2822024-11-19T05:50:55.572ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }
2832024-11-19T05:50:55.581ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2842024-11-19T05:50:55.581ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2852024-11-19T05:50:55.581ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2862024-11-19T05:50:55.581ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2872024-11-19T05:50:55.581ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2882024-11-19T05:50:55.581ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2892024-11-19T05:50:55.581ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2902024-11-19T05:50:55.616ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2912024-11-19T05:50:55.623ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8f726703-f78a-4246-88d2-b12195677e7c/crypt/zone file = sled-storage/src/dataset.rs:303
2922024-11-19T05:50:55.798ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8f726703-f78a-4246-88d2-b12195677e7c file = sled-storage/src/dataset.rs:389
2932024-11-19T05:50:55.805ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2942024-11-19T05:50:55.805ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2952024-11-19T05:50:55.805ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2962024-11-19T05:50:55.805ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2972024-11-19T05:50:55.805ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2982024-11-19T05:50:55.815ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2992024-11-19T05:50:55.815ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool)
3002024-11-19T05:50:55.907ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }
3012024-11-19T05:50:55.916ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
3022024-11-19T05:50:55.916ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
3032024-11-19T05:50:55.916ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
3042024-11-19T05:50:55.916ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
3052024-11-19T05:50:55.916ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3062024-11-19T05:50:55.916ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3072024-11-19T05:50:55.916ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3082024-11-19T05:50:55.950ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3092024-11-19T05:50:55.959ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15/crypt/zone file = sled-storage/src/dataset.rs:303
3102024-11-19T05:50:56.087ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/176942d8-6f67-414d-8390-55e992dfe909) file = sled-agent/src/probe_manager.rs:231 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
3112024-11-19T05:50:56.128ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 file = sled-storage/src/dataset.rs:389
3122024-11-19T05:50:56.135ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3132024-11-19T05:50:56.135ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3142024-11-19T05:50:56.135ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3152024-11-19T05:50:56.135ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3162024-11-19T05:50:56.135ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3172024-11-19T05:50:56.145ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3182024-11-19T05:50:56.145ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool)
3192024-11-19T05:50:56.238ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }
3202024-11-19T05:50:56.246ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3212024-11-19T05:50:56.246ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3222024-11-19T05:50:56.246ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3232024-11-19T05:50:56.246ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3242024-11-19T05:50:56.246ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3252024-11-19T05:50:56.246ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3262024-11-19T05:50:56.246ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3272024-11-19T05:50:56.284ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3282024-11-19T05:50:56.293ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_35a1f44b-de46-41ee-ad1e-96313ecc15b9/crypt/zone file = sled-storage/src/dataset.rs:303
3292024-11-19T05:50:56.470ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_35a1f44b-de46-41ee-ad1e-96313ecc15b9 file = sled-storage/src/dataset.rs:389
3302024-11-19T05:50:56.478ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3312024-11-19T05:50:56.478ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3322024-11-19T05:50:56.478ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3332024-11-19T05:50:56.478ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3342024-11-19T05:50:56.478ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3352024-11-19T05:50:56.488ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3362024-11-19T05:50:56.488ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool)
3372024-11-19T05:50:56.582ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }
3382024-11-19T05:50:56.590ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3392024-11-19T05:50:56.590ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3402024-11-19T05:50:56.590ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3412024-11-19T05:50:56.590ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3422024-11-19T05:50:56.590ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3432024-11-19T05:50:56.590ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3442024-11-19T05:50:56.590ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3452024-11-19T05:50:56.626ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3462024-11-19T05:50:56.634ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c5fdd794-3bc8-49cb-89e3-b36cc4eb9892/crypt/zone file = sled-storage/src/dataset.rs:303
3472024-11-19T05:50:56.807ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 file = sled-storage/src/dataset.rs:389
3482024-11-19T05:50:56.815ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3492024-11-19T05:50:56.815ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3502024-11-19T05:50:56.815ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3512024-11-19T05:50:56.815ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3522024-11-19T05:50:56.815ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3532024-11-19T05:50:56.825ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3542024-11-19T05:50:56.825ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool)
3552024-11-19T05:50:56.922ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }
3562024-11-19T05:50:56.930ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3572024-11-19T05:50:56.930ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3582024-11-19T05:50:56.930ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3592024-11-19T05:50:56.930ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3602024-11-19T05:50:56.930ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3612024-11-19T05:50:56.930ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3622024-11-19T05:50:56.930ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3632024-11-19T05:50:56.964ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3642024-11-19T05:50:56.972ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b94b817f-675d-49a5-b1c9-b8c4fb8b401d/crypt/zone file = sled-storage/src/dataset.rs:303
3652024-11-19T05:50:57.090ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/176942d8-6f67-414d-8390-55e992dfe909) file = sled-agent/src/probe_manager.rs:231 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
3662024-11-19T05:50:57.150ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b94b817f-675d-49a5-b1c9-b8c4fb8b401d file = sled-storage/src/dataset.rs:389
3672024-11-19T05:50:57.158ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3682024-11-19T05:50:57.158ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3692024-11-19T05:50:57.158ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3702024-11-19T05:50:57.158ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3712024-11-19T05:50:57.158ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3722024-11-19T05:50:57.167ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3732024-11-19T05:50:57.167ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool)
3742024-11-19T05:50:57.263ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External }
3752024-11-19T05:50:57.271ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3762024-11-19T05:50:57.271ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3772024-11-19T05:50:57.271ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3782024-11-19T05:50:57.271ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3792024-11-19T05:50:57.271ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3802024-11-19T05:50:57.271ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3812024-11-19T05:50:57.271ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3822024-11-19T05:50:57.306ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3832024-11-19T05:50:57.314ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5c871af8-68dd-4136-bfd3-234cd1e72e1e/crypt/zone file = sled-storage/src/dataset.rs:303
3842024-11-19T05:50:57.489ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5c871af8-68dd-4136-bfd3-234cd1e72e1e file = sled-storage/src/dataset.rs:389
3852024-11-19T05:50:57.497ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3862024-11-19T05:50:57.497ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3872024-11-19T05:50:57.497ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3882024-11-19T05:50:57.497ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3892024-11-19T05:50:57.497ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3902024-11-19T05:50:57.507ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3912024-11-19T05:50:57.507ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2d68dcb6-83b9-430c-b8d8-fa955e9efd1b (zpool)
3922024-11-19T05:50:57.599ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2d68dcb6-83b9-430c-b8d8-fa955e9efd1b (zpool), kind: External }
3932024-11-19T05:50:57.606ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3942024-11-19T05:50:57.606ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3952024-11-19T05:50:57.606ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3962024-11-19T05:50:57.606ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3972024-11-19T05:50:57.606ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3982024-11-19T05:50:57.607ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3992024-11-19T05:50:57.607ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4002024-11-19T05:50:57.640ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4012024-11-19T05:50:57.648ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2d68dcb6-83b9-430c-b8d8-fa955e9efd1b/crypt/zone file = sled-storage/src/dataset.rs:303
4022024-11-19T05:50:57.820ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2d68dcb6-83b9-430c-b8d8-fa955e9efd1b file = sled-storage/src/dataset.rs:389
4032024-11-19T05:50:57.828ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4042024-11-19T05:50:57.828ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4052024-11-19T05:50:57.828ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4062024-11-19T05:50:57.828ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4072024-11-19T05:50:57.828ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4082024-11-19T05:50:57.838ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4092024-11-19T05:50:57.838ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9 (zpool)
4102024-11-19T05:50:57.935ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9 (zpool), kind: External }
4112024-11-19T05:50:57.943ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4122024-11-19T05:50:57.943ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4132024-11-19T05:50:57.943ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4142024-11-19T05:50:57.944ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4152024-11-19T05:50:57.944ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4162024-11-19T05:50:57.944ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4172024-11-19T05:50:57.944ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4182024-11-19T05:50:57.979ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4192024-11-19T05:50:57.988ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9/crypt/zone file = sled-storage/src/dataset.rs:303
4202024-11-19T05:50:58.091ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/176942d8-6f67-414d-8390-55e992dfe909) file = sled-agent/src/probe_manager.rs:231 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
4212024-11-19T05:50:58.176ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9 file = sled-storage/src/dataset.rs:389
4222024-11-19T05:50:58.184ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4232024-11-19T05:50:58.184ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4242024-11-19T05:50:58.184ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4252024-11-19T05:50:58.184ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4262024-11-19T05:50:58.184ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4272024-11-19T05:50:58.195ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4282024-11-19T05:50:58.195ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool)
4292024-11-19T05:50:58.289ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool), kind: External }
4302024-11-19T05:50:58.299ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4312024-11-19T05:50:58.299ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4322024-11-19T05:50:58.299ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4332024-11-19T05:50:58.299ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4342024-11-19T05:50:58.299ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4352024-11-19T05:50:58.299ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4362024-11-19T05:50:58.299ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4372024-11-19T05:50:58.334ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4382024-11-19T05:50:58.342ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_685f3f58-b5f9-4e42-8994-bdac247f87cd/crypt/zone file = sled-storage/src/dataset.rs:303
4392024-11-19T05:50:58.518ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_685f3f58-b5f9-4e42-8994-bdac247f87cd file = sled-storage/src/dataset.rs:389
4402024-11-19T05:50:58.526ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4412024-11-19T05:50:58.526ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4422024-11-19T05:50:58.526ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4432024-11-19T05:50:58.526ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e96bca9b-11cd-4c01-9e26-77ae8318b28c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 309add57-857d-42cd-8f12-8351d275a791 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2d68dcb6-83b9-430c-b8d8-fa955e9efd1b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4442024-11-19T05:50:58.527ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4452024-11-19T05:50:58.527ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4462024-11-19T05:50:58.527ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4472024-11-19T05:50:58.527ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:888 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
4482024-11-19T05:50:58.527ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4492024-11-19T05:50:58.527ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:914 generation = Generation(1) sled_id = 176942d8-6f67-414d-8390-55e992dfe909
4502024-11-19T05:50:58.527ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:919 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
4512024-11-19T05:50:58.527ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:924 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
4522024-11-19T05:50:58.527ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = 176942d8-6f67-414d-8390-55e992dfe909
4532024-11-19T05:50:58.527ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:930 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
4542024-11-19T05:50:58.527ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4552024-11-19T05:50:58.527ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:935 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
4562024-11-19T05:50:58.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4055109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:51911 req_id = b777e7c9-337e-4d1f-9847-6208586f42a5 response_code = 200 uri = /omicron-physical-disks
4572024-11-19T05:50:58.559ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {00ef36eb-3a05-4d17-93ab-85a3b7a8d41d (dataset): DatasetConfig { id: 00ef36eb-3a05-4d17-93ab-85a3b7a8d41d (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 02ebb523-cc35-4e12-b582-8875ab485a15 (dataset): DatasetConfig { id: 02ebb523-cc35-4e12-b582-8875ab485a15 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b339ace-0f23-4d8d-97e9-d3ac8bc0dbb4 (dataset): DatasetConfig { id: 0b339ace-0f23-4d8d-97e9-d3ac8bc0dbb4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b42db44-f087-4194-9e33-7a86b31f159f (dataset): DatasetConfig { id: 0b42db44-f087-4194-9e33-7a86b31f159f (dataset), name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 111409ed-e9b8-4441-983d-09a7e3393b0a (dataset): DatasetConfig { id: 111409ed-e9b8-4441-983d-09a7e3393b0a (dataset), name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12738c19-9f69-4858-abf0-372a923ee3c8 (dataset): DatasetConfig { id: 12738c19-9f69-4858-abf0-372a923ee3c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1688485e-2a8a-4bc2-8f8e-c63e287370b3 (dataset): DatasetConfig { id: 1688485e-2a8a-4bc2-8f8e-c63e287370b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18a7136d-2e1e-46b1-892d-974b023b177f (dataset): DatasetConfig { id: 18a7136d-2e1e-46b1-892d-974b023b177f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d68dcb6-83b9-430c-b8d8-fa955e9efd1b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18d13878-f69e-4995-90ec-ff39d7e71c24 (dataset): DatasetConfig { id: 18d13878-f69e-4995-90ec-ff39d7e71c24 (dataset), name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a00d329-1dd5-4c6d-b315-701950773c0f (dataset): DatasetConfig { id: 1a00d329-1dd5-4c6d-b315-701950773c0f (dataset), name: DatasetName { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1bbfac2b-66cc-405e-adb5-0dbefc823313 (dataset): DatasetConfig { id: 1bbfac2b-66cc-405e-adb5-0dbefc823313 (dataset), name: DatasetName { pool_name: ZpoolName { id: b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1d0e3735-4fca-4e97-9b9c-2a8a8652b438 (dataset): DatasetConfig { id: 1d0e3735-4fca-4e97-9b9c-2a8a8652b438 (dataset), name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1d60f32e-2def-4034-94ea-3a73daf53125 (dataset): DatasetConfig { id: 1d60f32e-2def-4034-94ea-3a73daf53125 (dataset), name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e9cfebe-625e-4395-9650-30ee2f00ad49 (dataset): DatasetConfig { id: 1e9cfebe-625e-4395-9650-30ee2f00ad49 (dataset), name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 24695c48-4844-41d1-8c1a-45c39e5db2e7 (dataset): DatasetConfig { id: 24695c48-4844-41d1-8c1a-45c39e5db2e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 24d80c95-ff60-4506-9d4e-4552a44a262e (dataset): DatasetConfig { id: 24d80c95-ff60-4506-9d4e-4552a44a262e (dataset), name: DatasetName { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 27e06196-bcca-4122-8c97-2f2752d144d8 (dataset): DatasetConfig { id: 27e06196-bcca-4122-8c97-2f2752d144d8 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2b74ea4e-c8e8-4a9d-92ab-0b5b0aef4a0d (dataset): DatasetConfig { id: 2b74ea4e-c8e8-4a9d-92ab-0b5b0aef4a0d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d68dcb6-83b9-430c-b8d8-fa955e9efd1b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2f3434c7-cfb7-45ae-861b-e21584ab5044 (dataset): DatasetConfig { id: 2f3434c7-cfb7-45ae-861b-e21584ab5044 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d68dcb6-83b9-430c-b8d8-fa955e9efd1b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3bf7d0f5-6ee8-4e5e-9a27-49892e67f2f6 (dataset): DatasetConfig { id: 3bf7d0f5-6ee8-4e5e-9a27-49892e67f2f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d68dcb6-83b9-430c-b8d8-fa955e9efd1b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e8e8287-3735-4d52-85ab-f7af2d7cc822 (dataset): DatasetConfig { id: 3e8e8287-3735-4d52-85ab-f7af2d7cc822 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 40d129b7-bff1-4d65-9c82-7de562702954 (dataset): DatasetConfig { id: 40d129b7-bff1-4d65-9c82-7de562702954 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_8318957c-506a-4355-8689-147ab934628e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 429aaacd-ac67-4cc2-8fb1-48d92fbd9f93 (dataset): DatasetConfig { id: 429aaacd-ac67-4cc2-8fb1-48d92fbd9f93 (dataset), name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 48b95a15-9889-497d-82d3-6fe3565132f3 (dataset): DatasetConfig { id: 48b95a15-9889-497d-82d3-6fe3565132f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5559ce94-3067-4d7e-bd92-bd616515273d (dataset): DatasetConfig { id: 5559ce94-3067-4d7e-bd92-bd616515273d (dataset), name: DatasetName { pool_name: ZpoolName { id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58a87a08-c29a-4845-826f-7f30a0bcc628 (dataset): DatasetConfig { id: 58a87a08-c29a-4845-826f-7f30a0bcc628 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 629080ea-18fa-4f38-82bd-fc41aa06001b (dataset): DatasetConfig { id: 629080ea-18fa-4f38-82bd-fc41aa06001b (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 671524ad-983c-4a24-91e0-f75ccb9b463c (dataset): DatasetConfig { id: 671524ad-983c-4a24-91e0-f75ccb9b463c (dataset), name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c77423b-099b-4132-9281-a6ffefa3e2f1 (dataset): DatasetConfig { id: 6c77423b-099b-4132-9281-a6ffefa3e2f1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6d2ee80d-39ab-422d-b767-23925ebb8968 (dataset): DatasetConfig { id: 6d2ee80d-39ab-422d-b767-23925ebb8968 (dataset), name: DatasetName { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7243f038-e9d0-4c49-830b-2496c497d87e (dataset): DatasetConfig { id: 7243f038-e9d0-4c49-830b-2496c497d87e (dataset), name: DatasetName { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 73007537-190c-4f6e-913f-65936112d8b1 (dataset): DatasetConfig { id: 73007537-190c-4f6e-913f-65936112d8b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7994fac8-5225-4cf6-81e1-f0c7d1a60ca0 (dataset): DatasetConfig { id: 7994fac8-5225-4cf6-81e1-f0c7d1a60ca0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a033646-3a22-44ad-98cc-55534ee6f0b4 (dataset): DatasetConfig { id: 7a033646-3a22-44ad-98cc-55534ee6f0b4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cd797fd-8484-427d-a829-e1c7f046511e (dataset): DatasetConfig { id: 7cd797fd-8484-427d-a829-e1c7f046511e (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7fa6b145-2a47-40f6-bf2d-3bcc11e0336a (dataset): DatasetConfig { id: 7fa6b145-2a47-40f6-bf2d-3bcc11e0336a (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 812f8300-ee8a-48b1-a00c-3e126524c9f3 (dataset): DatasetConfig { id: 812f8300-ee8a-48b1-a00c-3e126524c9f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82a2f41c-8b6c-4627-93f9-7444431a2da9 (dataset): DatasetConfig { id: 82a2f41c-8b6c-4627-93f9-7444431a2da9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 835fa8ce-af65-449a-99ac-0042141d3211 (dataset): DatasetConfig { id: 835fa8ce-af65-449a-99ac-0042141d3211 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8615c821-b1b6-4a4f-96d1-ce130f16d653 (dataset): DatasetConfig { id: 8615c821-b1b6-4a4f-96d1-ce130f16d653 (dataset), name: DatasetName { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91274525-d2f7-4420-807a-22e10d4ace02 (dataset): DatasetConfig { id: 91274525-d2f7-4420-807a-22e10d4ace02 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91714349-bf3a-4676-807a-a3fbc644d5e4 (dataset): DatasetConfig { id: 91714349-bf3a-4676-807a-a3fbc644d5e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9b0dd0bf-45f5-4538-94cc-cf6e5acb5997 (dataset): DatasetConfig { id: 9b0dd0bf-45f5-4538-94cc-cf6e5acb5997 (dataset), name: DatasetName { pool_name: ZpoolName { id: b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a2fef851-993b-47a3-90b0-48456f3756cd (dataset): DatasetConfig { id: a2fef851-993b-47a3-90b0-48456f3756cd (dataset), name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a4033833-d975-4300-9c8e-6258942b582c (dataset): DatasetConfig { id: a4033833-d975-4300-9c8e-6258942b582c (dataset), name: DatasetName { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a64bfe57-2f14-4808-9bbe-2a891b7af9b5 (dataset): DatasetConfig { id: a64bfe57-2f14-4808-9bbe-2a891b7af9b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a6835458-a440-4eb0-acd8-5d9f9abd4f14 (dataset): DatasetConfig { id: a6835458-a440-4eb0-acd8-5d9f9abd4f14 (dataset), name: DatasetName { pool_name: ZpoolName { id: b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b4435362-5d56-4cbe-8239-68fd12600c68 (dataset): DatasetConfig { id: b4435362-5d56-4cbe-8239-68fd12600c68 (dataset), name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b83df7d6-385a-4af4-836d-1aa9f45b0e50 (dataset): DatasetConfig { id: b83df7d6-385a-4af4-836d-1aa9f45b0e50 (dataset), name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8472449-a25e-4b0c-8945-cb8e117f9915 (dataset): DatasetConfig { id: b8472449-a25e-4b0c-8945-cb8e117f9915 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc1fa119-594d-4ed8-9d0e-6035fe79475e (dataset): DatasetConfig { id: bc1fa119-594d-4ed8-9d0e-6035fe79475e (dataset), name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd16e5a1-cec9-43fb-9f8e-a3fab00be6ab (dataset): DatasetConfig { id: bd16e5a1-cec9-43fb-9f8e-a3fab00be6ab (dataset), name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c06fb350-1512-4023-9438-6a9891801841 (dataset): DatasetConfig { id: c06fb350-1512-4023-9438-6a9891801841 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c80dd8b2-bdf2-4a18-85ec-4b10e7dc56b7 (dataset): DatasetConfig { id: c80dd8b2-bdf2-4a18-85ec-4b10e7dc56b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c921c4f9-f8df-48a5-ac28-b9eda9d7b27a (dataset): DatasetConfig { id: c921c4f9-f8df-48a5-ac28-b9eda9d7b27a (dataset), name: DatasetName { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cdf078f3-36dd-4a51-8888-1f0ee25778cc (dataset): DatasetConfig { id: cdf078f3-36dd-4a51-8888-1f0ee25778cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cec53675-bdcd-4196-b155-369acc32eeaf (dataset): DatasetConfig { id: cec53675-bdcd-4196-b155-369acc32eeaf (dataset), name: DatasetName { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0ce3453-6307-466f-a7e2-cb876b58ef70 (dataset): DatasetConfig { id: d0ce3453-6307-466f-a7e2-cb876b58ef70 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d408765a-7ed4-45ff-b47e-3656d8619c4d (dataset): DatasetConfig { id: d408765a-7ed4-45ff-b47e-3656d8619c4d (dataset), name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, da9cf5af-c93a-429c-ad52-808144c963d4 (dataset): DatasetConfig { id: da9cf5af-c93a-429c-ad52-808144c963d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, db32a7e9-8eff-4258-81ec-f6e2221f1436 (dataset): DatasetConfig { id: db32a7e9-8eff-4258-81ec-f6e2221f1436 (dataset), name: DatasetName { pool_name: ZpoolName { id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, dec060ad-fe44-4321-8692-9ca446739268 (dataset): DatasetConfig { id: dec060ad-fe44-4321-8692-9ca446739268 (dataset), name: DatasetName { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e1cc997a-9428-44e4-82fc-48499563bd4b (dataset): DatasetConfig { id: e1cc997a-9428-44e4-82fc-48499563bd4b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, edff6a9a-9fee-4dc8-9d79-7245888bdd00 (dataset): DatasetConfig { id: edff6a9a-9fee-4dc8-9d79-7245888bdd00 (dataset), name: DatasetName { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4c1ea33-b1ae-4983-953d-292428606ad1 (dataset): DatasetConfig { id: f4c1ea33-b1ae-4983-953d-292428606ad1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fdbd0a3d-b101-47f9-8740-b032a37a2e05 (dataset): DatasetConfig { id: fdbd0a3d-b101-47f9-8740-b032a37a2e05 (dataset), name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:457 sled_address = [fd00:1122:3344:101::1]:12345
4582024-11-19T05:50:58.559ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34486
4592024-11-19T05:50:58.559ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:850 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
4602024-11-19T05:50:58.560ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {00ef36eb-3a05-4d17-93ab-85a3b7a8d41d (dataset): DatasetConfig { id: 00ef36eb-3a05-4d17-93ab-85a3b7a8d41d (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 02ebb523-cc35-4e12-b582-8875ab485a15 (dataset): DatasetConfig { id: 02ebb523-cc35-4e12-b582-8875ab485a15 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b339ace-0f23-4d8d-97e9-d3ac8bc0dbb4 (dataset): DatasetConfig { id: 0b339ace-0f23-4d8d-97e9-d3ac8bc0dbb4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b42db44-f087-4194-9e33-7a86b31f159f (dataset): DatasetConfig { id: 0b42db44-f087-4194-9e33-7a86b31f159f (dataset), name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 111409ed-e9b8-4441-983d-09a7e3393b0a (dataset): DatasetConfig { id: 111409ed-e9b8-4441-983d-09a7e3393b0a (dataset), name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12738c19-9f69-4858-abf0-372a923ee3c8 (dataset): DatasetConfig { id: 12738c19-9f69-4858-abf0-372a923ee3c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1688485e-2a8a-4bc2-8f8e-c63e287370b3 (dataset): DatasetConfig { id: 1688485e-2a8a-4bc2-8f8e-c63e287370b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18a7136d-2e1e-46b1-892d-974b023b177f (dataset): DatasetConfig { id: 18a7136d-2e1e-46b1-892d-974b023b177f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d68dcb6-83b9-430c-b8d8-fa955e9efd1b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18d13878-f69e-4995-90ec-ff39d7e71c24 (dataset): DatasetConfig { id: 18d13878-f69e-4995-90ec-ff39d7e71c24 (dataset), name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a00d329-1dd5-4c6d-b315-701950773c0f (dataset): DatasetConfig { id: 1a00d329-1dd5-4c6d-b315-701950773c0f (dataset), name: DatasetName { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1bbfac2b-66cc-405e-adb5-0dbefc823313 (dataset): DatasetConfig { id: 1bbfac2b-66cc-405e-adb5-0dbefc823313 (dataset), name: DatasetName { pool_name: ZpoolName { id: b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1d0e3735-4fca-4e97-9b9c-2a8a8652b438 (dataset): DatasetConfig { id: 1d0e3735-4fca-4e97-9b9c-2a8a8652b438 (dataset), name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1d60f32e-2def-4034-94ea-3a73daf53125 (dataset): DatasetConfig { id: 1d60f32e-2def-4034-94ea-3a73daf53125 (dataset), name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e9cfebe-625e-4395-9650-30ee2f00ad49 (dataset): DatasetConfig { id: 1e9cfebe-625e-4395-9650-30ee2f00ad49 (dataset), name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 24695c48-4844-41d1-8c1a-45c39e5db2e7 (dataset): DatasetConfig { id: 24695c48-4844-41d1-8c1a-45c39e5db2e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 24d80c95-ff60-4506-9d4e-4552a44a262e (dataset): DatasetConfig { id: 24d80c95-ff60-4506-9d4e-4552a44a262e (dataset), name: DatasetName { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 27e06196-bcca-4122-8c97-2f2752d144d8 (dataset): DatasetConfig { id: 27e06196-bcca-4122-8c97-2f2752d144d8 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2b74ea4e-c8e8-4a9d-92ab-0b5b0aef4a0d (dataset): DatasetConfig { id: 2b74ea4e-c8e8-4a9d-92ab-0b5b0aef4a0d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d68dcb6-83b9-430c-b8d8-fa955e9efd1b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2f3434c7-cfb7-45ae-861b-e21584ab5044 (dataset): DatasetConfig { id: 2f3434c7-cfb7-45ae-861b-e21584ab5044 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d68dcb6-83b9-430c-b8d8-fa955e9efd1b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3bf7d0f5-6ee8-4e5e-9a27-49892e67f2f6 (dataset): DatasetConfig { id: 3bf7d0f5-6ee8-4e5e-9a27-49892e67f2f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d68dcb6-83b9-430c-b8d8-fa955e9efd1b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e8e8287-3735-4d52-85ab-f7af2d7cc822 (dataset): DatasetConfig { id: 3e8e8287-3735-4d52-85ab-f7af2d7cc822 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 40d129b7-bff1-4d65-9c82-7de562702954 (dataset): DatasetConfig { id: 40d129b7-bff1-4d65-9c82-7de562702954 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_8318957c-506a-4355-8689-147ab934628e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 429aaacd-ac67-4cc2-8fb1-48d92fbd9f93 (dataset): DatasetConfig { id: 429aaacd-ac67-4cc2-8fb1-48d92fbd9f93 (dataset), name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 48b95a15-9889-497d-82d3-6fe3565132f3 (dataset): DatasetConfig { id: 48b95a15-9889-497d-82d3-6fe3565132f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5559ce94-3067-4d7e-bd92-bd616515273d (dataset): DatasetConfig { id: 5559ce94-3067-4d7e-bd92-bd616515273d (dataset), name: DatasetName { pool_name: ZpoolName { id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58a87a08-c29a-4845-826f-7f30a0bcc628 (dataset): DatasetConfig { id: 58a87a08-c29a-4845-826f-7f30a0bcc628 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 629080ea-18fa-4f38-82bd-fc41aa06001b (dataset): DatasetConfig { id: 629080ea-18fa-4f38-82bd-fc41aa06001b (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 671524ad-983c-4a24-91e0-f75ccb9b463c (dataset): DatasetConfig { id: 671524ad-983c-4a24-91e0-f75ccb9b463c (dataset), name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c77423b-099b-4132-9281-a6ffefa3e2f1 (dataset): DatasetConfig { id: 6c77423b-099b-4132-9281-a6ffefa3e2f1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6d2ee80d-39ab-422d-b767-23925ebb8968 (dataset): DatasetConfig { id: 6d2ee80d-39ab-422d-b767-23925ebb8968 (dataset), name: DatasetName { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7243f038-e9d0-4c49-830b-2496c497d87e (dataset): DatasetConfig { id: 7243f038-e9d0-4c49-830b-2496c497d87e (dataset), name: DatasetName { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 73007537-190c-4f6e-913f-65936112d8b1 (dataset): DatasetConfig { id: 73007537-190c-4f6e-913f-65936112d8b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7994fac8-5225-4cf6-81e1-f0c7d1a60ca0 (dataset): DatasetConfig { id: 7994fac8-5225-4cf6-81e1-f0c7d1a60ca0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a033646-3a22-44ad-98cc-55534ee6f0b4 (dataset): DatasetConfig { id: 7a033646-3a22-44ad-98cc-55534ee6f0b4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cd797fd-8484-427d-a829-e1c7f046511e (dataset): DatasetConfig { id: 7cd797fd-8484-427d-a829-e1c7f046511e (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7fa6b145-2a47-40f6-bf2d-3bcc11e0336a (dataset): DatasetConfig { id: 7fa6b145-2a47-40f6-bf2d-3bcc11e0336a (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 812f8300-ee8a-48b1-a00c-3e126524c9f3 (dataset): DatasetConfig { id: 812f8300-ee8a-48b1-a00c-3e126524c9f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82a2f41c-8b6c-4627-93f9-7444431a2da9 (dataset): DatasetConfig { id: 82a2f41c-8b6c-4627-93f9-7444431a2da9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 835fa8ce-af65-449a-99ac-0042141d3211 (dataset): DatasetConfig { id: 835fa8ce-af65-449a-99ac-0042141d3211 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8615c821-b1b6-4a4f-96d1-ce130f16d653 (dataset): DatasetConfig { id: 8615c821-b1b6-4a4f-96d1-ce130f16d653 (dataset), name: DatasetName { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91274525-d2f7-4420-807a-22e10d4ace02 (dataset): DatasetConfig { id: 91274525-d2f7-4420-807a-22e10d4ace02 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91714349-bf3a-4676-807a-a3fbc644d5e4 (dataset): DatasetConfig { id: 91714349-bf3a-4676-807a-a3fbc644d5e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9b0dd0bf-45f5-4538-94cc-cf6e5acb5997 (dataset): DatasetConfig { id: 9b0dd0bf-45f5-4538-94cc-cf6e5acb5997 (dataset), name: DatasetName { pool_name: ZpoolName { id: b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a2fef851-993b-47a3-90b0-48456f3756cd (dataset): DatasetConfig { id: a2fef851-993b-47a3-90b0-48456f3756cd (dataset), name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a4033833-d975-4300-9c8e-6258942b582c (dataset): DatasetConfig { id: a4033833-d975-4300-9c8e-6258942b582c (dataset), name: DatasetName { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a64bfe57-2f14-4808-9bbe-2a891b7af9b5 (dataset): DatasetConfig { id: a64bfe57-2f14-4808-9bbe-2a891b7af9b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a6835458-a440-4eb0-acd8-5d9f9abd4f14 (dataset): DatasetConfig { id: a6835458-a440-4eb0-acd8-5d9f9abd4f14 (dataset), name: DatasetName { pool_name: ZpoolName { id: b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b4435362-5d56-4cbe-8239-68fd12600c68 (dataset): DatasetConfig { id: b4435362-5d56-4cbe-8239-68fd12600c68 (dataset), name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b83df7d6-385a-4af4-836d-1aa9f45b0e50 (dataset): DatasetConfig { id: b83df7d6-385a-4af4-836d-1aa9f45b0e50 (dataset), name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8472449-a25e-4b0c-8945-cb8e117f9915 (dataset): DatasetConfig { id: b8472449-a25e-4b0c-8945-cb8e117f9915 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc1fa119-594d-4ed8-9d0e-6035fe79475e (dataset): DatasetConfig { id: bc1fa119-594d-4ed8-9d0e-6035fe79475e (dataset), name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd16e5a1-cec9-43fb-9f8e-a3fab00be6ab (dataset): DatasetConfig { id: bd16e5a1-cec9-43fb-9f8e-a3fab00be6ab (dataset), name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c06fb350-1512-4023-9438-6a9891801841 (dataset): DatasetConfig { id: c06fb350-1512-4023-9438-6a9891801841 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c80dd8b2-bdf2-4a18-85ec-4b10e7dc56b7 (dataset): DatasetConfig { id: c80dd8b2-bdf2-4a18-85ec-4b10e7dc56b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c921c4f9-f8df-48a5-ac28-b9eda9d7b27a (dataset): DatasetConfig { id: c921c4f9-f8df-48a5-ac28-b9eda9d7b27a (dataset), name: DatasetName { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cdf078f3-36dd-4a51-8888-1f0ee25778cc (dataset): DatasetConfig { id: cdf078f3-36dd-4a51-8888-1f0ee25778cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cec53675-bdcd-4196-b155-369acc32eeaf (dataset): DatasetConfig { id: cec53675-bdcd-4196-b155-369acc32eeaf (dataset), name: DatasetName { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0ce3453-6307-466f-a7e2-cb876b58ef70 (dataset): DatasetConfig { id: d0ce3453-6307-466f-a7e2-cb876b58ef70 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d408765a-7ed4-45ff-b47e-3656d8619c4d (dataset): DatasetConfig { id: d408765a-7ed4-45ff-b47e-3656d8619c4d (dataset), name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, da9cf5af-c93a-429c-ad52-808144c963d4 (dataset): DatasetConfig { id: da9cf5af-c93a-429c-ad52-808144c963d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, db32a7e9-8eff-4258-81ec-f6e2221f1436 (dataset): DatasetConfig { id: db32a7e9-8eff-4258-81ec-f6e2221f1436 (dataset), name: DatasetName { pool_name: ZpoolName { id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, dec060ad-fe44-4321-8692-9ca446739268 (dataset): DatasetConfig { id: dec060ad-fe44-4321-8692-9ca446739268 (dataset), name: DatasetName { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e1cc997a-9428-44e4-82fc-48499563bd4b (dataset): DatasetConfig { id: e1cc997a-9428-44e4-82fc-48499563bd4b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, edff6a9a-9fee-4dc8-9d79-7245888bdd00 (dataset): DatasetConfig { id: edff6a9a-9fee-4dc8-9d79-7245888bdd00 (dataset), name: DatasetName { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4c1ea33-b1ae-4983-953d-292428606ad1 (dataset): DatasetConfig { id: f4c1ea33-b1ae-4983-953d-292428606ad1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fdbd0a3d-b101-47f9-8740-b032a37a2e05 (dataset): DatasetConfig { id: fdbd0a3d-b101-47f9-8740-b032a37a2e05 (dataset), name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4612024-11-19T05:50:58.560ZINFOSledAgent (StorageManager): No ledger in /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4622024-11-19T05:50:58.560ZINFOSledAgent (StorageManager): No ledger in /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4632024-11-19T05:50:58.560ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4642024-11-19T05:50:58.560ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4652024-11-19T05:50:58.560ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8f726703-f78a-4246-88d2-b12195677e7c/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
4662024-11-19T05:50:58.648ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4672024-11-19T05:50:58.648ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8f726703-f78a-4246-88d2-b12195677e7c/crypt/zone/oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040"), full_name: "oxp_8f726703-f78a-4246-88d2-b12195677e7c/crypt/zone/oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040" } file = sled-storage/src/manager.rs:1331
4682024-11-19T05:50:58.744ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4692024-11-19T05:50:58.744ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8f726703-f78a-4246-88d2-b12195677e7c/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
4702024-11-19T05:50:58.832ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4712024-11-19T05:50:58.832ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
4722024-11-19T05:50:58.921ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4732024-11-19T05:50:58.921ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_35a1f44b-de46-41ee-ad1e-96313ecc15b9/crucible" } file = sled-storage/src/manager.rs:1331
4742024-11-19T05:50:59.009ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4752024-11-19T05:50:59.009ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9/crypt/zone/oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526"), full_name: "oxp_b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9/crypt/zone/oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526" } file = sled-storage/src/manager.rs:1331
4762024-11-19T05:50:59.093ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/176942d8-6f67-414d-8390-55e992dfe909) file = sled-agent/src/probe_manager.rs:231 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
4772024-11-19T05:50:59.110ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4782024-11-19T05:50:59.110ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/685f3f58-b5f9-4e42-8994-bdac247f87cd/crypt/zone/oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722"), full_name: "oxp_685f3f58-b5f9-4e42-8994-bdac247f87cd/crypt/zone/oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722" } file = sled-storage/src/manager.rs:1331
4792024-11-19T05:50:59.209ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4802024-11-19T05:50:59.209ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2d68dcb6-83b9-430c-b8d8-fa955e9efd1b/crucible" } file = sled-storage/src/manager.rs:1331
4812024-11-19T05:50:59.299ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4822024-11-19T05:50:59.299ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15/crypt/zone/oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4"), full_name: "oxp_d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15/crypt/zone/oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4" } file = sled-storage/src/manager.rs:1331
4832024-11-19T05:50:59.400ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4842024-11-19T05:50:59.400ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b94b817f-675d-49a5-b1c9-b8c4fb8b401d/crypt/zone/oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98"), full_name: "oxp_b94b817f-675d-49a5-b1c9-b8c4fb8b401d/crypt/zone/oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98" } file = sled-storage/src/manager.rs:1331
4852024-11-19T05:50:59.498ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4862024-11-19T05:50:59.498ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9/crucible" } file = sled-storage/src/manager.rs:1331
4872024-11-19T05:50:59.584ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4882024-11-19T05:50:59.584ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
4892024-11-19T05:50:59.675ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4902024-11-19T05:50:59.675ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_35a1f44b-de46-41ee-ad1e-96313ecc15b9/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4912024-11-19T05:50:59.771ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4922024-11-19T05:50:59.771ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15/crypt/zone"), full_name: "oxp_d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15/crypt/zone" } file = sled-storage/src/manager.rs:1331
4932024-11-19T05:50:59.840ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4942024-11-19T05:50:59.840ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_685f3f58-b5f9-4e42-8994-bdac247f87cd/crucible" } file = sled-storage/src/manager.rs:1331
4952024-11-19T05:50:59.928ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4962024-11-19T05:50:59.929ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b94b817f-675d-49a5-b1c9-b8c4fb8b401d/crypt/debug"), full_name: "oxp_b94b817f-675d-49a5-b1c9-b8c4fb8b401d/crypt/debug" } file = sled-storage/src/manager.rs:1331
4972024-11-19T05:50:59.998ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4982024-11-19T05:50:59.998ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c5fdd794-3bc8-49cb-89e3-b36cc4eb9892/crucible" } file = sled-storage/src/manager.rs:1331
4992024-11-19T05:51:00.087ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5002024-11-19T05:51:00.087ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2d68dcb6-83b9-430c-b8d8-fa955e9efd1b/crypt/zone/oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7"), full_name: "oxp_2d68dcb6-83b9-430c-b8d8-fa955e9efd1b/crypt/zone/oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7" } file = sled-storage/src/manager.rs:1331
5012024-11-19T05:51:00.098ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/176942d8-6f67-414d-8390-55e992dfe909) file = sled-agent/src/probe_manager.rs:231 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
5022024-11-19T05:51:00.189ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5032024-11-19T05:51:00.189ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2d68dcb6-83b9-430c-b8d8-fa955e9efd1b/crypt/debug"), full_name: "oxp_2d68dcb6-83b9-430c-b8d8-fa955e9efd1b/crypt/debug" } file = sled-storage/src/manager.rs:1331
5042024-11-19T05:51:00.259ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5052024-11-19T05:51:00.259ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2d68dcb6-83b9-430c-b8d8-fa955e9efd1b/crypt/zone"), full_name: "oxp_2d68dcb6-83b9-430c-b8d8-fa955e9efd1b/crypt/zone" } file = sled-storage/src/manager.rs:1331
5062024-11-19T05:51:00.328ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5072024-11-19T05:51:00.328ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c5fdd794-3bc8-49cb-89e3-b36cc4eb9892/crypt/zone/oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc"), full_name: "oxp_c5fdd794-3bc8-49cb-89e3-b36cc4eb9892/crypt/zone/oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc" } file = sled-storage/src/manager.rs:1331
5082024-11-19T05:51:00.426ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5092024-11-19T05:51:00.426ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c5fdd794-3bc8-49cb-89e3-b36cc4eb9892/crypt/zone/oxz_nexus_8318957c-506a-4355-8689-147ab934628e"), full_name: "oxp_c5fdd794-3bc8-49cb-89e3-b36cc4eb9892/crypt/zone/oxz_nexus_8318957c-506a-4355-8689-147ab934628e" } file = sled-storage/src/manager.rs:1331
5102024-11-19T05:51:00.526ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5112024-11-19T05:51:00.526ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/35a1f44b-de46-41ee-ad1e-96313ecc15b9/crypt/debug"), full_name: "oxp_35a1f44b-de46-41ee-ad1e-96313ecc15b9/crypt/debug" } file = sled-storage/src/manager.rs:1331
5122024-11-19T05:51:00.596ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5132024-11-19T05:51:00.597ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15/crypt/zone/oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737"), full_name: "oxp_d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15/crypt/zone/oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737" } file = sled-storage/src/manager.rs:1331
5142024-11-19T05:51:00.705ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5152024-11-19T05:51:00.705ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/685f3f58-b5f9-4e42-8994-bdac247f87cd/crypt/zone/oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966"), full_name: "oxp_685f3f58-b5f9-4e42-8994-bdac247f87cd/crypt/zone/oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966" } file = sled-storage/src/manager.rs:1331
5162024-11-19T05:51:00.740ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 13.189982466s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
5172024-11-19T05:51:00.807ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5182024-11-19T05:51:00.807ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8f726703-f78a-4246-88d2-b12195677e7c/crypt/zone/oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b"), full_name: "oxp_8f726703-f78a-4246-88d2-b12195677e7c/crypt/zone/oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b" } file = sled-storage/src/manager.rs:1331
5192024-11-19T05:51:00.907ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5202024-11-19T05:51:00.907ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8f726703-f78a-4246-88d2-b12195677e7c/crypt/zone/oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd"), full_name: "oxp_8f726703-f78a-4246-88d2-b12195677e7c/crypt/zone/oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd" } file = sled-storage/src/manager.rs:1331
5212024-11-19T05:51:01.011ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5222024-11-19T05:51:01.011ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/35a1f44b-de46-41ee-ad1e-96313ecc15b9/crypt/zone/oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e"), full_name: "oxp_35a1f44b-de46-41ee-ad1e-96313ecc15b9/crypt/zone/oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e" } file = sled-storage/src/manager.rs:1331
5232024-11-19T05:51:01.103ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/176942d8-6f67-414d-8390-55e992dfe909) file = sled-agent/src/probe_manager.rs:231 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
5242024-11-19T05:51:01.112ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5252024-11-19T05:51:01.112ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/685f3f58-b5f9-4e42-8994-bdac247f87cd/crypt/zone"), full_name: "oxp_685f3f58-b5f9-4e42-8994-bdac247f87cd/crypt/zone" } file = sled-storage/src/manager.rs:1331
5262024-11-19T05:51:01.182ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5272024-11-19T05:51:01.182ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b94b817f-675d-49a5-b1c9-b8c4fb8b401d/crucible" } file = sled-storage/src/manager.rs:1331
5282024-11-19T05:51:01.272ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5292024-11-19T05:51:01.272ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b94b817f-675d-49a5-b1c9-b8c4fb8b401d/crypt/zone/oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c"), full_name: "oxp_b94b817f-675d-49a5-b1c9-b8c4fb8b401d/crypt/zone/oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c" } file = sled-storage/src/manager.rs:1331
5302024-11-19T05:51:01.370ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5312024-11-19T05:51:01.370ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5c871af8-68dd-4136-bfd3-234cd1e72e1e/crypt/zone"), full_name: "oxp_5c871af8-68dd-4136-bfd3-234cd1e72e1e/crypt/zone" } file = sled-storage/src/manager.rs:1331
5322024-11-19T05:51:01.438ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5332024-11-19T05:51:01.438ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8f726703-f78a-4246-88d2-b12195677e7c/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5342024-11-19T05:51:01.530ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5352024-11-19T05:51:01.530ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8f726703-f78a-4246-88d2-b12195677e7c/crucible" } file = sled-storage/src/manager.rs:1331
5362024-11-19T05:51:01.618ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5372024-11-19T05:51:01.618ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5c871af8-68dd-4136-bfd3-234cd1e72e1e/crypt/debug"), full_name: "oxp_5c871af8-68dd-4136-bfd3-234cd1e72e1e/crypt/debug" } file = sled-storage/src/manager.rs:1331
5382024-11-19T05:51:01.687ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5392024-11-19T05:51:01.687ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8f726703-f78a-4246-88d2-b12195677e7c/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
5402024-11-19T05:51:01.781ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5412024-11-19T05:51:01.781ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8f726703-f78a-4246-88d2-b12195677e7c/crypt/zone/oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9"), full_name: "oxp_8f726703-f78a-4246-88d2-b12195677e7c/crypt/zone/oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9" } file = sled-storage/src/manager.rs:1331
5422024-11-19T05:51:01.880ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5432024-11-19T05:51:01.880ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8f726703-f78a-4246-88d2-b12195677e7c/crypt/zone"), full_name: "oxp_8f726703-f78a-4246-88d2-b12195677e7c/crypt/zone" } file = sled-storage/src/manager.rs:1331
5442024-11-19T05:51:01.948ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5452024-11-19T05:51:01.948ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c5fdd794-3bc8-49cb-89e3-b36cc4eb9892/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5462024-11-19T05:51:02.042ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5472024-11-19T05:51:02.042ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b94b817f-675d-49a5-b1c9-b8c4fb8b401d/crypt/zone/oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e"), full_name: "oxp_b94b817f-675d-49a5-b1c9-b8c4fb8b401d/crypt/zone/oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e" } file = sled-storage/src/manager.rs:1331
5482024-11-19T05:51:02.104ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/176942d8-6f67-414d-8390-55e992dfe909) file = sled-agent/src/probe_manager.rs:231 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
5492024-11-19T05:51:02.144ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5502024-11-19T05:51:02.144ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c5fdd794-3bc8-49cb-89e3-b36cc4eb9892/crypt/zone/oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23"), full_name: "oxp_c5fdd794-3bc8-49cb-89e3-b36cc4eb9892/crypt/zone/oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23" } file = sled-storage/src/manager.rs:1331
5512024-11-19T05:51:02.243ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5522024-11-19T05:51:02.243ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15/crucible" } file = sled-storage/src/manager.rs:1331
5532024-11-19T05:51:02.331ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5542024-11-19T05:51:02.331ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9/crypt/zone"), full_name: "oxp_b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9/crypt/zone" } file = sled-storage/src/manager.rs:1331
5552024-11-19T05:51:02.400ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5562024-11-19T05:51:02.400ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/35a1f44b-de46-41ee-ad1e-96313ecc15b9/crypt/zone"), full_name: "oxp_35a1f44b-de46-41ee-ad1e-96313ecc15b9/crypt/zone" } file = sled-storage/src/manager.rs:1331
5572024-11-19T05:51:02.469ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5582024-11-19T05:51:02.469ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c5fdd794-3bc8-49cb-89e3-b36cc4eb9892/crypt/zone/oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de"), full_name: "oxp_c5fdd794-3bc8-49cb-89e3-b36cc4eb9892/crypt/zone/oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de" } file = sled-storage/src/manager.rs:1331
5592024-11-19T05:51:02.567ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5602024-11-19T05:51:02.567ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15/crypt/zone/oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d"), full_name: "oxp_d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15/crypt/zone/oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d" } file = sled-storage/src/manager.rs:1331
5612024-11-19T05:51:02.670ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5622024-11-19T05:51:02.670ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9/crypt/debug"), full_name: "oxp_b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9/crypt/debug" } file = sled-storage/src/manager.rs:1331
5632024-11-19T05:51:02.739ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5642024-11-19T05:51:02.739ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_35a1f44b-de46-41ee-ad1e-96313ecc15b9/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5652024-11-19T05:51:02.829ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5662024-11-19T05:51:02.829ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/35a1f44b-de46-41ee-ad1e-96313ecc15b9/crypt/zone/oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658"), full_name: "oxp_35a1f44b-de46-41ee-ad1e-96313ecc15b9/crypt/zone/oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658" } file = sled-storage/src/manager.rs:1331
5672024-11-19T05:51:02.932ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5682024-11-19T05:51:02.932ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8f726703-f78a-4246-88d2-b12195677e7c/crypt/zone/oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7"), full_name: "oxp_8f726703-f78a-4246-88d2-b12195677e7c/crypt/zone/oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7" } file = sled-storage/src/manager.rs:1331
5692024-11-19T05:51:03.039ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5702024-11-19T05:51:03.039ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/35a1f44b-de46-41ee-ad1e-96313ecc15b9/crypt/zone/oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75"), full_name: "oxp_35a1f44b-de46-41ee-ad1e-96313ecc15b9/crypt/zone/oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75" } file = sled-storage/src/manager.rs:1331
5712024-11-19T05:51:03.107ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/176942d8-6f67-414d-8390-55e992dfe909) file = sled-agent/src/probe_manager.rs:231 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
5722024-11-19T05:51:03.164ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5732024-11-19T05:51:03.164ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5742024-11-19T05:51:03.260ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5752024-11-19T05:51:03.260ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c5fdd794-3bc8-49cb-89e3-b36cc4eb9892/crypt/debug"), full_name: "oxp_c5fdd794-3bc8-49cb-89e3-b36cc4eb9892/crypt/debug" } file = sled-storage/src/manager.rs:1331
5762024-11-19T05:51:03.333ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5772024-11-19T05:51:03.333ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15/crypt/zone/oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6"), full_name: "oxp_d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15/crypt/zone/oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6" } file = sled-storage/src/manager.rs:1331
5782024-11-19T05:51:03.435ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5792024-11-19T05:51:03.435ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c5fdd794-3bc8-49cb-89e3-b36cc4eb9892/crypt/zone"), full_name: "oxp_c5fdd794-3bc8-49cb-89e3-b36cc4eb9892/crypt/zone" } file = sled-storage/src/manager.rs:1331
5802024-11-19T05:51:03.506ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5812024-11-19T05:51:03.506ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5c871af8-68dd-4136-bfd3-234cd1e72e1e/crypt/zone/oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe"), full_name: "oxp_5c871af8-68dd-4136-bfd3-234cd1e72e1e/crypt/zone/oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe" } file = sled-storage/src/manager.rs:1331
5822024-11-19T05:51:03.605ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5832024-11-19T05:51:03.605ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b94b817f-675d-49a5-b1c9-b8c4fb8b401d/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5842024-11-19T05:51:03.698ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5852024-11-19T05:51:03.698ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8f726703-f78a-4246-88d2-b12195677e7c/crypt/zone/oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9"), full_name: "oxp_8f726703-f78a-4246-88d2-b12195677e7c/crypt/zone/oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9" } file = sled-storage/src/manager.rs:1331
5862024-11-19T05:51:03.807ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5872024-11-19T05:51:03.807ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15/crypt/debug"), full_name: "oxp_d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15/crypt/debug" } file = sled-storage/src/manager.rs:1331
5882024-11-19T05:51:03.876ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5892024-11-19T05:51:03.876ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8f726703-f78a-4246-88d2-b12195677e7c/crypt/debug"), full_name: "oxp_8f726703-f78a-4246-88d2-b12195677e7c/crypt/debug" } file = sled-storage/src/manager.rs:1331
5902024-11-19T05:51:03.941ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4272872868478667511 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
5912024-11-19T05:51:03.941ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8237544546331873503 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
5922024-11-19T05:51:03.943ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5932024-11-19T05:51:03.943ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/685f3f58-b5f9-4e42-8994-bdac247f87cd/crypt/debug"), full_name: "oxp_685f3f58-b5f9-4e42-8994-bdac247f87cd/crypt/debug" } file = sled-storage/src/manager.rs:1331
5942024-11-19T05:51:04.011ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5952024-11-19T05:51:04.011ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b94b817f-675d-49a5-b1c9-b8c4fb8b401d/crypt/zone"), full_name: "oxp_b94b817f-675d-49a5-b1c9-b8c4fb8b401d/crypt/zone" } file = sled-storage/src/manager.rs:1331
5962024-11-19T05:51:04.079ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5972024-11-19T05:51:04.079ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5c871af8-68dd-4136-bfd3-234cd1e72e1e/crucible" } file = sled-storage/src/manager.rs:1331
5982024-11-19T05:51:04.109ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/176942d8-6f67-414d-8390-55e992dfe909) file = sled-agent/src/probe_manager.rs:231 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
5992024-11-19T05:51:04.167ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6002024-11-19T05:51:04.167ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b94b817f-675d-49a5-b1c9-b8c4fb8b401d/crypt/zone/oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be"), full_name: "oxp_b94b817f-675d-49a5-b1c9-b8c4fb8b401d/crypt/zone/oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be" } file = sled-storage/src/manager.rs:1331
6012024-11-19T05:51:04.203ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
6022024-11-19T05:51:04.203ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
6032024-11-19T05:51:04.211ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
6042024-11-19T05:51:04.211ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
6052024-11-19T05:51:04.280ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6062024-11-19T05:51:04.281ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5c871af8-68dd-4136-bfd3-234cd1e72e1e/crypt/zone/oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d"), full_name: "oxp_5c871af8-68dd-4136-bfd3-234cd1e72e1e/crypt/zone/oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d" } file = sled-storage/src/manager.rs:1331
6072024-11-19T05:51:04.364ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
6082024-11-19T05:51:04.364ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
6092024-11-19T05:51:04.398ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6102024-11-19T05:51:04.398ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15/crypt/zone/oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458"), full_name: "oxp_d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15/crypt/zone/oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458" } file = sled-storage/src/manager.rs:1331
6112024-11-19T05:51:04.406ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
6122024-11-19T05:51:04.406ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
6132024-11-19T05:51:04.455ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
6142024-11-19T05:51:04.455ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
6152024-11-19T05:51:04.475ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
6162024-11-19T05:51:04.475ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
6172024-11-19T05:51:04.519ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6182024-11-19T05:51:04.519ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6192024-11-19T05:51:04.520ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:852 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
6202024-11-19T05:51:04.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5960935 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:34486 req_id = f8879079-640c-495c-8d96-2468dfc1f4c5 response_code = 200 uri = /datasets
6212024-11-19T05:51:04.542ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
6222024-11-19T05:51:04.542ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
6232024-11-19T05:51:04.566ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 8dc16782-541b-438c-82ef-18d39164ba3b (service), filesystem_pool: Some(ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f25e6486-b7ba-41a0-97d7-aa40f3d70ad4 (service), filesystem_pool: Some(ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: c51e8d3b-11f8-41aa-a061-9ba80e14ea5e (service), filesystem_pool: Some(ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
6242024-11-19T05:51:04.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34178
6252024-11-19T05:51:04.567ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8dc16782-541b-438c-82ef-18d39164ba3b, dataset_name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6262024-11-19T05:51:04.567ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 8dc16782-541b-438c-82ef-18d39164ba3b, dataset_name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: InternalDns }, responder: ... }
6272024-11-19T05:51:04.600ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f25e6486-b7ba-41a0-97d7-aa40f3d70ad4, dataset_name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6282024-11-19T05:51:04.600ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f25e6486-b7ba-41a0-97d7-aa40f3d70ad4, dataset_name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6292024-11-19T05:51:04.629ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
6302024-11-19T05:51:04.629ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6312024-11-19T05:51:04.631ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c51e8d3b-11f8-41aa-a061-9ba80e14ea5e, dataset_name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6322024-11-19T05:51:04.631ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c51e8d3b-11f8-41aa-a061-9ba80e14ea5e, dataset_name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6332024-11-19T05:51:04.664ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6342024-11-19T05:51:04.664ZINFOSledAgent (ServiceManager): No ledger in /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/omicron-zones.json file = common/src/ledger.rs:188
6352024-11-19T05:51:04.664ZINFOSledAgent (ServiceManager): No ledger in /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/omicron-zones.json file = common/src/ledger.rs:188
6362024-11-19T05:51:04.664ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6372024-11-19T05:51:04.683ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:418
6382024-11-19T05:51:04.684ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/176942d8-6f67-414d-8390-55e992dfe909) file = sled-agent/src/nexus.rs:527 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
6392024-11-19T05:51:04.707ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6402024-11-19T05:51:04.707ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6412024-11-19T05:51:04.707ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6422024-11-19T05:51:04.732ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:686
6432024-11-19T05:51:04.732ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:731
6442024-11-19T05:51:04.736ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:734 uptime = 1
6452024-11-19T05:51:04.736ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:440
6462024-11-19T05:51:04.762ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4 file = illumos-utils/src/zone.rs:325
6472024-11-19T05:51:04.766ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e file = illumos-utils/src/zone.rs:325
6482024-11-19T05:51:04.771ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b file = illumos-utils/src/zone.rs:325
6492024-11-19T05:51:04.783ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4 file = illumos-utils/src/zone.rs:363
6502024-11-19T05:51:04.787ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e file = illumos-utils/src/zone.rs:363
6512024-11-19T05:51:04.791ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b file = illumos-utils/src/zone.rs:363
6522024-11-19T05:51:04.802ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
6532024-11-19T05:51:04.853ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6542024-11-19T05:51:04.853ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6552024-11-19T05:51:04.853ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6562024-11-19T05:51:04.853ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6572024-11-19T05:51:04.853ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6582024-11-19T05:51:04.853ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6592024-11-19T05:51:04.853ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6602024-11-19T05:51:04.853ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6612024-11-19T05:51:04.853ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6622024-11-19T05:51:04.853ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6632024-11-19T05:51:04.853ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6642024-11-19T05:51:04.853ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6652024-11-19T05:51:04.853ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6662024-11-19T05:51:04.853ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6672024-11-19T05:51:04.853ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6682024-11-19T05:51:04.853ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6692024-11-19T05:51:04.853ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6702024-11-19T05:51:04.853ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6712024-11-19T05:51:04.853ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6722024-11-19T05:51:04.853ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6732024-11-19T05:51:04.853ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6742024-11-19T05:51:04.853ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6752024-11-19T05:51:04.853ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6762024-11-19T05:51:05.111ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/176942d8-6f67-414d-8390-55e992dfe909) file = sled-agent/src/probe_manager.rs:231 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
6772024-11-19T05:51:05.550ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5024699827489478459 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
6782024-11-19T05:51:05.550ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14012425544086727305 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
6792024-11-19T05:51:06.395ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6802024-11-19T05:51:06.395ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6812024-11-19T05:51:06.395ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b
6822024-11-19T05:51:06.879ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6832024-11-19T05:51:07.357ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6842024-11-19T05:51:07.357ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6852024-11-19T05:51:07.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b") failed: Property not found. retry in 47.93464ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b
6862024-11-19T05:51:07.364ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6872024-11-19T05:51:07.364ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4
6882024-11-19T05:51:07.369ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e
6892024-11-19T05:51:07.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b") failed: Property not found. retry in 141.009118ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b
6902024-11-19T05:51:07.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4") failed: Property not found. retry in 48.453806ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4
6912024-11-19T05:51:07.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e") failed: Property not found. retry in 25.48541ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e
6922024-11-19T05:51:07.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e") failed: Property not found. retry in 149.923344ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e
6932024-11-19T05:51:07.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4") failed: Property not found. retry in 124.622591ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4
6942024-11-19T05:51:07.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b") failed: Property not found. retry in 179.331758ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b
6952024-11-19T05:51:07.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4") failed: Property not found. retry in 296.987225ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4
6962024-11-19T05:51:07.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e") failed: Property not found. retry in 280.82418ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e
6972024-11-19T05:51:07.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b") failed: Property not found. retry in 357.198273ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b
6982024-11-19T05:51:08.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e") failed: Property not found. retry in 253.382285ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e
6992024-11-19T05:51:08.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4") failed: Property not found. retry in 422.425301ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4
7002024-11-19T05:51:08.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b") failed: Property not found. retry in 710.281099ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b
7012024-11-19T05:51:08.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e") failed: Property not found. retry in 545.957904ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e
7022024-11-19T05:51:08.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4") failed: Property not found. retry in 622.361393ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4
7032024-11-19T05:51:08.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b") failed: Property not found. retry in 590.659781ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b
7042024-11-19T05:51:08.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e") failed: Property not found. retry in 1.456860722s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e
7052024-11-19T05:51:09.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4") failed: Property not found. retry in 1.211069434s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4
7062024-11-19T05:51:09.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b") failed: Property not found. retry in 1.432659s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b
7072024-11-19T05:51:10.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e") failed: Property not found. retry in 1.475649853s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e
7082024-11-19T05:51:10.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4") failed: Property not found. retry in 919.699934ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4
7092024-11-19T05:51:11.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b") failed: Property not found. retry in 792.507204ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b
7102024-11-19T05:51:11.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4") failed: Property not found. retry in 780.865411ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4
7112024-11-19T05:51:11.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b") failed: Property not found. retry in 577.379771ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b
7122024-11-19T05:51:11.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e") failed: Property not found. retry in 806.198177ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e
7132024-11-19T05:51:12.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4") failed: Property not found. retry in 1.02318103s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4
7142024-11-19T05:51:13.213ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_f25e6486-b7ba-41a0-97d7-aa40f3d70ad4
7152024-11-19T05:51:13.213ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_c51e8d3b-11f8-41aa-a061-9ba80e14ea5e
7162024-11-19T05:51:13.213ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_8dc16782-541b-438c-82ef-18d39164ba3b
7172024-11-19T05:51:13.214ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7182024-11-19T05:51:13.214ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7192024-11-19T05:51:13.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8647279 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:34178 req_id = ce55c88a-e479-49e8-92ee-805aef054b61 response_code = 204 uri = /omicron-zones
7202024-11-19T05:51:13.216ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7212024-11-19T05:51:13.269ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7222024-11-19T05:51:13.428ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 57.737976ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:675
7232024-11-19T05:51:13.487ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 156.523111ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:675
7242024-11-19T05:51:13.661ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7252024-11-19T05:51:13.708ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:691
7262024-11-19T05:51:13.708ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7272024-11-19T05:51:13.740ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7282024-11-19T05:51:13.741ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7292024-11-19T05:51:13.741ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7302024-11-19T05:51:13.770ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 8dc16782-541b-438c-82ef-18d39164ba3b (service), filesystem_pool: Some(ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f25e6486-b7ba-41a0-97d7-aa40f3d70ad4 (service), filesystem_pool: Some(ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: c51e8d3b-11f8-41aa-a061-9ba80e14ea5e (service), filesystem_pool: Some(ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 8bbacb79-0bed-4a0f-8014-509852229dfe (service), filesystem_pool: Some(ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: f9908ed5-6310-4f6f-8957-a6444089e8a4, kind: Service { id: 8bbacb79-0bed-4a0f-8014-509852229dfe }, name: Name("ntp-8bbacb79-0bed-4a0f-8014-509852229dfe"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 240])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
7312024-11-19T05:51:13.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42638
7322024-11-19T05:51:13.770ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8dc16782-541b-438c-82ef-18d39164ba3b, dataset_name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7332024-11-19T05:51:13.770ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 8dc16782-541b-438c-82ef-18d39164ba3b, dataset_name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: InternalDns }, responder: ... }
7342024-11-19T05:51:13.809ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f25e6486-b7ba-41a0-97d7-aa40f3d70ad4, dataset_name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7352024-11-19T05:51:13.809ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f25e6486-b7ba-41a0-97d7-aa40f3d70ad4, dataset_name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7362024-11-19T05:51:13.846ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c51e8d3b-11f8-41aa-a061-9ba80e14ea5e, dataset_name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7372024-11-19T05:51:13.846ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c51e8d3b-11f8-41aa-a061-9ba80e14ea5e, dataset_name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7382024-11-19T05:51:13.879ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7392024-11-19T05:51:13.879ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/omicron-zones.json file = common/src/ledger.rs:177
7402024-11-19T05:51:13.879ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/omicron-zones.json file = common/src/ledger.rs:177
7412024-11-19T05:51:13.879ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7422024-11-19T05:51:13.890ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7432024-11-19T05:51:13.923ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7442024-11-19T05:51:13.924ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7452024-11-19T05:51:13.924ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7462024-11-19T05:51:13.974ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 155, 240]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7472024-11-19T05:51:13.974ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7482024-11-19T05:51:13.974ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7492024-11-19T05:51:13.974ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7502024-11-19T05:51:13.975ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7512024-11-19T05:51:13.975ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4272872868478667511 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
7522024-11-19T05:51:13.975ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8237544546331873503 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
7532024-11-19T05:51:13.976ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7542024-11-19T05:51:14.002ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe file = illumos-utils/src/zone.rs:325
7552024-11-19T05:51:14.021ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe file = illumos-utils/src/zone.rs:363
7562024-11-19T05:51:14.683ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7572024-11-19T05:51:14.683ZINFOSledAgent (ServiceManager): Booting oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe
7582024-11-19T05:51:14.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe") failed: Property not found. retry in 27.058031ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe
7592024-11-19T05:51:14.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe") failed: Property not found. retry in 135.319815ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe
7602024-11-19T05:51:14.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe") failed: Property not found. retry in 240.734055ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe
7612024-11-19T05:51:15.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe") failed: Property not found. retry in 207.497171ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe
7622024-11-19T05:51:15.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe") failed: Property not found. retry in 417.099212ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe
7632024-11-19T05:51:15.552ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5024699827489478459 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
7642024-11-19T05:51:15.553ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14012425544086727305 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
7652024-11-19T05:51:15.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe") failed: Property not found. retry in 728.920888ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe
7662024-11-19T05:51:16.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe") failed: Property not found. retry in 1.215873123s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe
7672024-11-19T05:51:17.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe") failed: Property not found. retry in 1.463161473s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe
7682024-11-19T05:51:19.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe") failed: Property not found. retry in 582.046808ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe
7692024-11-19T05:51:19.922ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe
7702024-11-19T05:51:19.922ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7712024-11-19T05:51:19.922ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7722024-11-19T05:51:19.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6152767 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:42638 req_id = 56729ab5-9183-43f7-bdb7-d8129368a7be response_code = 204 uri = /omicron-zones
7732024-11-19T05:51:19.925ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:732
7742024-11-19T05:51:19.956ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7752024-11-19T05:51:19.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37390
7762024-11-19T05:51:19.965ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7772024-11-19T05:51:19.965ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9084 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37390 req_id = 32cea996-3e9e-4723-80f5-bbe5979b289d response_code = 500 uri = /timesync
7782024-11-19T05:51:19.968ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7792024-11-19T05:51:20.132ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7802024-11-19T05:51:20.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55348
7812024-11-19T05:51:22.406ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16572996514975800712 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
7822024-11-19T05:51:22.750ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13320110450439319907 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
7832024-11-19T05:51:23.216ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4679023616319485646 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
7842024-11-19T05:51:23.977ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4272872868478667511 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
7852024-11-19T05:51:23.977ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8237544546331873503 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
7862024-11-19T05:51:24.140ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7872024-11-19T05:51:24.140ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4007795 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55348 req_id = 6af66a73-a876-4cf2-a8dc-adeb472fafa1 response_code = 500 uri = /timesync
7882024-11-19T05:51:24.142ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7892024-11-19T05:51:24.324ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7902024-11-19T05:51:24.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43403
7912024-11-19T05:51:24.333ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7922024-11-19T05:51:24.333ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8726 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43403 req_id = f12e1248-d04e-472a-ae2f-5a7579de2f39 response_code = 500 uri = /timesync
7932024-11-19T05:51:24.335ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7942024-11-19T05:51:24.568ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7952024-11-19T05:51:24.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59594
7962024-11-19T05:51:24.577ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_8bbacb79-0bed-4a0f-8014-509852229dfe': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7972024-11-19T05:51:24.577ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8309 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59594 req_id = eedb3f34-27b0-49c5-bb1d-094ee2b6b2fb response_code = 500 uri = /timesync
7982024-11-19T05:51:24.579ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7992024-11-19T05:51:24.704ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8002024-11-19T05:51:24.704ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48383
8012024-11-19T05:51:25.555ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5024699827489478459 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
8022024-11-19T05:51:25.555ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14012425544086727305 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
8032024-11-19T05:51:26.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48383 req_id = a5f6e1f4-c243-41e4-b753-03a34c324dd9 response_code = 200 uri = /timesync
8042024-11-19T05:51:26.715ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8052024-11-19T05:51:26.715ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8062024-11-19T05:51:26.994ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8072024-11-19T05:51:26.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34371
8082024-11-19T05:51:27.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8485 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34371 req_id = abe767c0-9205-4848-9549-ac3986ace6b5 response_code = 200 uri = /timesync
8092024-11-19T05:51:27.006ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8102024-11-19T05:51:27.006ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8112024-11-19T05:51:27.075ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8122024-11-19T05:51:27.075ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52464
8132024-11-19T05:51:27.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8789 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52464 req_id = 09ce6af1-8026-4480-8d4e-5380811ea644 response_code = 200 uri = /timesync
8142024-11-19T05:51:27.088ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8152024-11-19T05:51:27.088ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8162024-11-19T05:51:27.082ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8172024-11-19T05:51:27.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52840
8182024-11-19T05:51:27.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7743 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52840 req_id = c4d71964-a08f-498f-9050-5e3019110a4a response_code = 200 uri = /timesync
8192024-11-19T05:51:27.093ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8202024-11-19T05:51:27.093ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8212024-11-19T05:51:27.547ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8222024-11-19T05:51:27.547ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47657
8232024-11-19T05:51:27.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47657 req_id = ddae5f81-08e4-4e2a-ab08-1f648e60d88b response_code = 200 uri = /timesync
8242024-11-19T05:51:27.559ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.032199636 } file = sled-agent/src/rack_setup/service.rs:740
8252024-11-19T05:51:27.559ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8262024-11-19T05:51:27.921ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8272024-11-19T05:51:27.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47811
8282024-11-19T05:51:27.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47811 req_id = 7a1282e5-b40b-4423-9d1e-806de9064f09 response_code = 200 uri = /timesync
8292024-11-19T05:51:27.932ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.031188324 } file = sled-agent/src/rack_setup/service.rs:740
8302024-11-19T05:51:27.932ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8312024-11-19T05:51:28.441ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 322.92501ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
8322024-11-19T05:51:28.667ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8332024-11-19T05:51:28.667ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63017
8342024-11-19T05:51:28.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63017 req_id = 839b40b3-1981-492e-9572-9bf2291b44d9 response_code = 200 uri = /timesync
8352024-11-19T05:51:28.678ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.034895733 } file = sled-agent/src/rack_setup/service.rs:740
8362024-11-19T05:51:28.678ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8372024-11-19T05:51:29.368ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8383807782211892831 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
8382024-11-19T05:51:29.368ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1732903203247072660 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
8392024-11-19T05:51:29.463ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8402024-11-19T05:51:29.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43487
8412024-11-19T05:51:29.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7604 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43487 req_id = 8cbb68bd-cd3d-4ab5-9c3c-84037d5bce60 response_code = 200 uri = /timesync
8422024-11-19T05:51:29.472ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.037706695 } file = sled-agent/src/rack_setup/service.rs:740
8432024-11-19T05:51:29.472ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8442024-11-19T05:51:30.506ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8452024-11-19T05:51:30.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38390
8462024-11-19T05:51:30.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7992 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38390 req_id = b7a03fae-5744-4b2b-bc9f-1545cd5c9a34 response_code = 200 uri = /timesync
8472024-11-19T05:51:30.516ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.024451451 } file = sled-agent/src/rack_setup/service.rs:740
8482024-11-19T05:51:30.516ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8492024-11-19T05:51:31.865ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8502024-11-19T05:51:31.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39563
8512024-11-19T05:51:31.869ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16572996514975800712 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
8522024-11-19T05:51:31.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7609 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39563 req_id = 2a39440d-06d8-497b-91b1-e6910c46d137 response_code = 200 uri = /timesync
8532024-11-19T05:51:31.877ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.024194796 } file = sled-agent/src/rack_setup/service.rs:740
8542024-11-19T05:51:31.877ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8552024-11-19T05:51:32.187ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13320110450439319907 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
8562024-11-19T05:51:32.651ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4679023616319485646 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
8572024-11-19T05:51:32.775ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8582024-11-19T05:51:32.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61948
8592024-11-19T05:51:32.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61948 req_id = 283807fd-cb2e-43cd-865c-f714fc205055 response_code = 200 uri = /timesync
8602024-11-19T05:51:32.787ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.021722374 } file = sled-agent/src/rack_setup/service.rs:740
8612024-11-19T05:51:32.787ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8622024-11-19T05:51:33.411ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4272872868478667511 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
8632024-11-19T05:51:33.411ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8237544546331873503 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
8642024-11-19T05:51:33.834ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49588
8652024-11-19T05:51:33.834ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49588 req_id = 8297dd71-383c-43d4-9e7d-0448957155ed response_code = 200 uri = /baseboard
8662024-11-19T05:51:34.579ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8672024-11-19T05:51:34.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57615
8682024-11-19T05:51:34.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8309 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57615 req_id = d07a3f44-c44c-4af9-a24c-7cfc6be555ee response_code = 200 uri = /timesync
8692024-11-19T05:51:34.589ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.016823109 } file = sled-agent/src/rack_setup/service.rs:740
8702024-11-19T05:51:34.589ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8712024-11-19T05:51:34.984ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5024699827489478459 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
8722024-11-19T05:51:34.984ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14012425544086727305 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
8732024-11-19T05:51:36.726ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8742024-11-19T05:51:36.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43333
8752024-11-19T05:51:36.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8442 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43333 req_id = 544690cb-4744-48c9-89f3-de6351603871 response_code = 200 uri = /timesync
8762024-11-19T05:51:36.737ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.010990631 } file = sled-agent/src/rack_setup/service.rs:740
8772024-11-19T05:51:36.738ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8782024-11-19T05:51:38.846ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8792024-11-19T05:51:38.846ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33027
8802024-11-19T05:51:38.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20469 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33027 req_id = f87fdb9e-4072-4ff8-8af7-a26eb38797eb response_code = 200 uri = /timesync
8812024-11-19T05:51:38.870ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2907267140, ip_addr: 173.73.96.68, stratum: 3, ref_time: 1731995497.2289834, correction: -0.002250073 } file = sled-agent/src/rack_setup/service.rs:740
8822024-11-19T05:51:38.870ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1425
8832024-11-19T05:51:38.899ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 8dc16782-541b-438c-82ef-18d39164ba3b (service), filesystem_pool: Some(ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f25e6486-b7ba-41a0-97d7-aa40f3d70ad4 (service), filesystem_pool: Some(ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: c51e8d3b-11f8-41aa-a061-9ba80e14ea5e (service), filesystem_pool: Some(ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 8bbacb79-0bed-4a0f-8014-509852229dfe (service), filesystem_pool: Some(ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: f9908ed5-6310-4f6f-8957-a6444089e8a4, kind: Service { id: 8bbacb79-0bed-4a0f-8014-509852229dfe }, name: Name("ntp-8bbacb79-0bed-4a0f-8014-509852229dfe"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 240])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 1da99676-0ffd-4a85-a090-0f82be6d0ccd (service), filesystem_pool: Some(ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External } } } }, OmicronZoneConfig { id: 8a5e4adf-7dd3-4aa0-a818-be5781f94737 (service), filesystem_pool: Some(ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External } } } }, OmicronZoneConfig { id: cb7977f7-7ade-43f2-8efa-e915b4c02658 (service), filesystem_pool: Some(ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 426e44b0-e306-4318-9242-c63415399f23 (service), filesystem_pool: Some(ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External } } } }, OmicronZoneConfig { id: 537d1a13-24cc-46d5-bfb0-4d8742745e9c (service), filesystem_pool: Some(ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
8842024-11-19T05:51:38.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61083
8852024-11-19T05:51:38.899ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8dc16782-541b-438c-82ef-18d39164ba3b, dataset_name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8862024-11-19T05:51:38.899ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 8dc16782-541b-438c-82ef-18d39164ba3b, dataset_name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: InternalDns }, responder: ... }
8872024-11-19T05:51:38.934ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f25e6486-b7ba-41a0-97d7-aa40f3d70ad4, dataset_name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8882024-11-19T05:51:38.934ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f25e6486-b7ba-41a0-97d7-aa40f3d70ad4, dataset_name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8892024-11-19T05:51:38.967ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c51e8d3b-11f8-41aa-a061-9ba80e14ea5e, dataset_name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8902024-11-19T05:51:38.967ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c51e8d3b-11f8-41aa-a061-9ba80e14ea5e, dataset_name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8912024-11-19T05:51:39.000ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1da99676-0ffd-4a85-a090-0f82be6d0ccd, dataset_name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8922024-11-19T05:51:39.000ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1da99676-0ffd-4a85-a090-0f82be6d0ccd, dataset_name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: Cockroach }, responder: ... }
8932024-11-19T05:51:39.034ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8a5e4adf-7dd3-4aa0-a818-be5781f94737, dataset_name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8942024-11-19T05:51:39.034ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 8a5e4adf-7dd3-4aa0-a818-be5781f94737, dataset_name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8952024-11-19T05:51:39.068ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cb7977f7-7ade-43f2-8efa-e915b4c02658, dataset_name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8962024-11-19T05:51:39.068ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: cb7977f7-7ade-43f2-8efa-e915b4c02658, dataset_name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8972024-11-19T05:51:39.099ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 426e44b0-e306-4318-9242-c63415399f23, dataset_name: DatasetName { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8982024-11-19T05:51:39.099ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 426e44b0-e306-4318-9242-c63415399f23, dataset_name: DatasetName { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8992024-11-19T05:51:39.131ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 537d1a13-24cc-46d5-bfb0-4d8742745e9c, dataset_name: DatasetName { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
9002024-11-19T05:51:39.131ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 537d1a13-24cc-46d5-bfb0-4d8742745e9c, dataset_name: DatasetName { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, kind: Cockroach }, responder: ... }
9012024-11-19T05:51:39.162ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9022024-11-19T05:51:39.162ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/omicron-zones.json file = common/src/ledger.rs:177
9032024-11-19T05:51:39.162ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/omicron-zones.json file = common/src/ledger.rs:177
9042024-11-19T05:51:39.162ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9052024-11-19T05:51:39.245ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9062024-11-19T05:51:39.245ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9072024-11-19T05:51:39.245ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9082024-11-19T05:51:39.245ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9092024-11-19T05:51:39.245ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9102024-11-19T05:51:39.336ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737 file = illumos-utils/src/zone.rs:325
9112024-11-19T05:51:39.340ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c file = illumos-utils/src/zone.rs:325
9122024-11-19T05:51:39.345ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658 file = illumos-utils/src/zone.rs:325
9132024-11-19T05:51:39.350ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23 file = illumos-utils/src/zone.rs:325
9142024-11-19T05:51:39.354ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd file = illumos-utils/src/zone.rs:325
9152024-11-19T05:51:39.358ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737 file = illumos-utils/src/zone.rs:363
9162024-11-19T05:51:39.363ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c file = illumos-utils/src/zone.rs:363
9172024-11-19T05:51:39.367ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658 file = illumos-utils/src/zone.rs:363
9182024-11-19T05:51:39.372ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23 file = illumos-utils/src/zone.rs:363
9192024-11-19T05:51:39.376ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd file = illumos-utils/src/zone.rs:363
9202024-11-19T05:51:42.276ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='426e44b0-e306-4318-9242-c63415399f23'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9212024-11-19T05:51:42.276ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23
9222024-11-19T05:51:42.294ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='1da99676-0ffd-4a85-a090-0f82be6d0ccd'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9232024-11-19T05:51:42.294ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd
9242024-11-19T05:51:42.355ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='8a5e4adf-7dd3-4aa0-a818-be5781f94737'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9252024-11-19T05:51:42.355ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737
9262024-11-19T05:51:42.400ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='537d1a13-24cc-46d5-bfb0-4d8742745e9c'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9272024-11-19T05:51:42.400ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
9282024-11-19T05:51:42.406ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='cb7977f7-7ade-43f2-8efa-e915b4c02658'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9292024-11-19T05:51:42.406ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658
9302024-11-19T05:51:42.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23") failed: Property not found. retry in 48.509866ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23
9312024-11-19T05:51:42.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd") failed: Property not found. retry in 52.474897ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd
9322024-11-19T05:51:42.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737") failed: Property not found. retry in 53.670121ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737
9332024-11-19T05:51:42.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23") failed: Property not found. retry in 59.519591ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23
9342024-11-19T05:51:42.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd") failed: Property not found. retry in 93.936441ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd
9352024-11-19T05:51:42.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737") failed: Property not found. retry in 127.564663ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737
9362024-11-19T05:51:42.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 48.242289ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
9372024-11-19T05:51:42.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658") failed: Property not found. retry in 41.235219ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658
9382024-11-19T05:51:42.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23") failed: Property not found. retry in 196.9123ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23
9392024-11-19T05:51:43.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd") failed: Property not found. retry in 103.526168ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd
9402024-11-19T05:51:43.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737") failed: Property not found. retry in 219.697064ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737
9412024-11-19T05:51:43.794ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 353.98296ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
9422024-11-19T05:51:43.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 51.470787ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
9432024-11-19T05:51:44.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658") failed: Property not found. retry in 102.037026ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658
9442024-11-19T05:51:44.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23") failed: Property not found. retry in 449.098006ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23
9452024-11-19T05:51:44.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd") failed: Property not found. retry in 587.079787ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd
9462024-11-19T05:51:44.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737") failed: Property not found. retry in 293.971181ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737
9472024-11-19T05:51:44.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 105.136856ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
9482024-11-19T05:51:45.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658") failed: Property not found. retry in 284.898308ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658
9492024-11-19T05:51:45.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23") failed: Property not found. retry in 1.003362088s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23
9502024-11-19T05:51:45.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd") failed: Property not found. retry in 778.300685ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd
9512024-11-19T05:51:45.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737") failed: Property not found. retry in 1.083669139s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737
9522024-11-19T05:51:45.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 430.475885ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
9532024-11-19T05:51:45.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658") failed: Property not found. retry in 527.166771ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658
9542024-11-19T05:51:45.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 902.035617ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
9552024-11-19T05:51:46.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658") failed: Property not found. retry in 1.026815914s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658
9562024-11-19T05:51:46.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd") failed: Property not found. retry in 1.002090295s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd
9572024-11-19T05:51:46.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23") failed: Property not found. retry in 968.874864ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23
9582024-11-19T05:51:46.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737") failed: Property not found. retry in 1.39106337s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737
9592024-11-19T05:51:46.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 1.192616485s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
9602024-11-19T05:51:47.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd") failed: Property not found. retry in 733.352664ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd
9612024-11-19T05:51:47.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658") failed: Property not found. retry in 1.167154628s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658
9622024-11-19T05:51:47.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23") failed: Property not found. retry in 1.06059498s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23
9632024-11-19T05:51:47.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737") failed: Property not found. retry in 890.917906ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737
9642024-11-19T05:51:47.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd") failed: Property not found. retry in 1.161206344s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd
9652024-11-19T05:51:47.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 1.192119592s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
9662024-11-19T05:51:48.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658") failed: Property not found. retry in 1.15958775s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658
9672024-11-19T05:51:48.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23") failed: Property not found. retry in 516.652867ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23
9682024-11-19T05:51:48.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737") failed: Property not found. retry in 508.326997ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737
9692024-11-19T05:51:48.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23") failed: Property not found. retry in 915.129832ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23
9702024-11-19T05:51:49.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd") failed: Property not found. retry in 1.013530148s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd
9712024-11-19T05:51:49.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 824.485691ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
9722024-11-19T05:51:49.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737") failed: Property not found. retry in 1.21020005s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737
9732024-11-19T05:51:49.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658") failed: Property not found. retry in 1.146786338s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658
9742024-11-19T05:51:49.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23") failed: Property not found. retry in 1.422428589s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23
9752024-11-19T05:51:50.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 1.23224637s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
9762024-11-19T05:51:50.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd") failed: Property not found. retry in 1.480501158s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd
9772024-11-19T05:51:50.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737") failed: Property not found. retry in 1.241539241s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737
9782024-11-19T05:51:50.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658") failed: Property not found. retry in 1.334461372s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658
9792024-11-19T05:51:51.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 1.017031341s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
9802024-11-19T05:51:51.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23") failed: Property not found. retry in 1.177838463s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23
9812024-11-19T05:51:51.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd") failed: Property not found. retry in 1.261812264s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd
9822024-11-19T05:51:51.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737") failed: Property not found. retry in 842.937779ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737
9832024-11-19T05:51:52.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658") failed: Property not found. retry in 575.512537ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658
9842024-11-19T05:51:52.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 1.444628594s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
9852024-11-19T05:51:52.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23") failed: Property not found. retry in 1.012633938s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23
9862024-11-19T05:51:52.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737") failed: Property not found. retry in 900.827607ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737
9872024-11-19T05:51:52.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658") failed: Property not found. retry in 1.011179474s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658
9882024-11-19T05:51:52.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd") failed: Property not found. retry in 1.122777851s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd
9892024-11-19T05:51:53.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23") failed: Property not found. retry in 698.759724ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23
9902024-11-19T05:51:53.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737") failed: Property not found. retry in 1.101148823s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737
9912024-11-19T05:51:53.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658") failed: Property not found. retry in 1.206438229s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658
9922024-11-19T05:51:53.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 1.205152145s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
9932024-11-19T05:51:54.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd") failed: Property not found. retry in 1.081661157s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd
9942024-11-19T05:51:54.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23") failed: Property not found. retry in 612.93219ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23
9952024-11-19T05:51:54.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737") failed: Property not found. retry in 1.25650625s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737
9962024-11-19T05:51:54.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23") failed: Property not found. retry in 1.233397546s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23
9972024-11-19T05:51:54.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658") failed: Property not found. retry in 1.477032383s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658
9982024-11-19T05:51:54.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 1.272345102s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
9992024-11-19T05:51:55.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd") failed: Property not found. retry in 964.049556ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd
10002024-11-19T05:51:55.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737") failed: Property not found. retry in 975.539876ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737
10012024-11-19T05:51:56.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23") failed: Property not found. retry in 1.249889025s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23
10022024-11-19T05:51:56.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd") failed: Property not found. retry in 1.202764789s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd
10032024-11-19T05:51:56.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 669.257135ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
10042024-11-19T05:51:56.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658") failed: Property not found. retry in 1.446603341s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658
10052024-11-19T05:51:56.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 1.231972408s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
10062024-11-19T05:51:56.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737") failed: Property not found. retry in 1.299628478s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737
10072024-11-19T05:51:57.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd") failed: Property not found. retry in 1.422994952s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd
10082024-11-19T05:51:57.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23") failed: Property not found. retry in 1.076039804s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23
10092024-11-19T05:51:57.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658") failed: Property not found. retry in 831.008331ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658
10102024-11-19T05:51:58.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 793.166879ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
10112024-11-19T05:51:58.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737") failed: Property not found. retry in 738.609128ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737
10122024-11-19T05:51:58.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23") failed: Property not found. retry in 664.401366ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23
10132024-11-19T05:51:58.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658") failed: Property not found. retry in 1.313225067s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658
10142024-11-19T05:51:58.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd") failed: Property not found. retry in 1.084216369s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd
10152024-11-19T05:51:58.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 1.490248124s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
10162024-11-19T05:52:00.423ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 660.894477ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
10172024-11-19T05:52:00.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 780.515732ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
10182024-11-19T05:52:01.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 1.097744872s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
10192024-11-19T05:52:02.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 1.378081642s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
10202024-11-19T05:52:03.861ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55948
10212024-11-19T05:52:03.861ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55948 req_id = 690f1e8b-c5fe-458b-8a88-2ee8b73ab399 response_code = 200 uri = /baseboard
10222024-11-19T05:52:04.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 1.220104253s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
10232024-11-19T05:52:05.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 1.314803709s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
10242024-11-19T05:52:06.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 777.545682ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
10252024-11-19T05:52:07.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 1.101560109s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
10262024-11-19T05:52:08.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 557.311456ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
10272024-11-19T05:52:09.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 801.1449ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
10282024-11-19T05:52:10.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 639.339381ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
10292024-11-19T05:52:10.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 1.324462504s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
10302024-11-19T05:52:12.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c") failed: Property not found. retry in 792.529708ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
10312024-11-19T05:52:12.838ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_8a5e4adf-7dd3-4aa0-a818-be5781f94737
10322024-11-19T05:52:12.838ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_537d1a13-24cc-46d5-bfb0-4d8742745e9c
10332024-11-19T05:52:12.839ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_cb7977f7-7ade-43f2-8efa-e915b4c02658
10342024-11-19T05:52:12.839ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_426e44b0-e306-4318-9242-c63415399f23
10352024-11-19T05:52:12.839ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_1da99676-0ffd-4a85-a090-0f82be6d0ccd
10362024-11-19T05:52:12.839ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10372024-11-19T05:52:12.842ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10382024-11-19T05:52:12.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33946779 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61083 req_id = 847b5ace-e932-4e9d-8441-205e017b5929 response_code = 204 uri = /omicron-zones
10392024-11-19T05:52:12.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59047
10402024-11-19T05:52:12.929ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:3743
10412024-11-19T05:52:20.481ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
10422024-11-19T05:52:29.461ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
10432024-11-19T05:52:29.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16569435 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:59047 req_id = 0ee02c70-e6d5-4ba5-8bc1-85005ea8a0c3 response_code = 204 uri = /cockroachdb
10442024-11-19T05:52:29.466ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.650203557s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
10452024-11-19T05:52:29.496ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 8dc16782-541b-438c-82ef-18d39164ba3b (service), filesystem_pool: Some(ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f25e6486-b7ba-41a0-97d7-aa40f3d70ad4 (service), filesystem_pool: Some(ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: c51e8d3b-11f8-41aa-a061-9ba80e14ea5e (service), filesystem_pool: Some(ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 8bbacb79-0bed-4a0f-8014-509852229dfe (service), filesystem_pool: Some(ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: f9908ed5-6310-4f6f-8957-a6444089e8a4, kind: Service { id: 8bbacb79-0bed-4a0f-8014-509852229dfe }, name: Name("ntp-8bbacb79-0bed-4a0f-8014-509852229dfe"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 240])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 1da99676-0ffd-4a85-a090-0f82be6d0ccd (service), filesystem_pool: Some(ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External } } } }, OmicronZoneConfig { id: 8a5e4adf-7dd3-4aa0-a818-be5781f94737 (service), filesystem_pool: Some(ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External } } } }, OmicronZoneConfig { id: cb7977f7-7ade-43f2-8efa-e915b4c02658 (service), filesystem_pool: Some(ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 426e44b0-e306-4318-9242-c63415399f23 (service), filesystem_pool: Some(ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External } } } }, OmicronZoneConfig { id: 537d1a13-24cc-46d5-bfb0-4d8742745e9c (service), filesystem_pool: Some(ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External } } } }, OmicronZoneConfig { id: c29d6cd6-2a42-4173-b7b2-1125c4e42dc9 (service), filesystem_pool: Some(ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: d1b85f63-706d-4ace-ba0e-597770a5fb36, kind: Service { id: c29d6cd6-2a42-4173-b7b2-1125c4e42dc9 }, name: Name("external-dns-c29d6cd6-2a42-4173-b7b2-1125c4e42dc9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 99])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: bb4d79db-b332-4dd4-8e52-fcecf48e448d (service), filesystem_pool: Some(ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 256f247e-4de6-49b2-a232-cf77d0f780e4, kind: Service { id: bb4d79db-b332-4dd4-8e52-fcecf48e448d }, name: Name("external-dns-bb4d79db-b332-4dd4-8e52-fcecf48e448d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 218])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 8318957c-506a-4355-8689-147ab934628e (service), filesystem_pool: Some(ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: ff00a53c-dab4-46e5-9026-b7386ebdd8fd, kind: Service { id: 8318957c-506a-4355-8689-147ab934628e }, name: Name("nexus-8318957c-506a-4355-8689-147ab934628e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 3ad742bb-4404-4a65-bfcd-5935cc6c6458 (service), filesystem_pool: Some(ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 16dfcd1a-39ad-4d73-ad80-575882a493b7, kind: Service { id: 3ad742bb-4404-4a65-bfcd-5935cc6c6458 }, name: Name("nexus-3ad742bb-4404-4a65-bfcd-5935cc6c6458"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 67225c0a-0a53-4e08-a753-a917553c7b98 (service), filesystem_pool: Some(ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 06879b4d-7caa-4269-9225-8fc437aa415d, kind: Service { id: 67225c0a-0a53-4e08-a753-a917553c7b98 }, name: Name("nexus-67225c0a-0a53-4e08-a753-a917553c7b98"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: da1ff28e-ea87-4bc7-83f5-781f17826bcc (service), filesystem_pool: Some(ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 38ebcc96-958b-4c68-8f89-a38fd71ccbb9 (service), filesystem_pool: Some(ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External } } } }, OmicronZoneConfig { id: 6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7 (service), filesystem_pool: Some(ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: d54f3e43-0b89-49ad-b18d-35bf37245966 (service), filesystem_pool: Some(ZpoolName { id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 7696d96b-ff75-4d64-9a41-983528504a2e (service), filesystem_pool: Some(ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 5b86554c-1fdb-4572-96a3-d35456303040 (service), filesystem_pool: Some(ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External } } } }, OmicronZoneConfig { id: 68bb655e-6fb1-48fe-87bc-8a66c2dd37d6 (service), filesystem_pool: Some(ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9a256def-dc34-4e28-a778-837b612c3e75 (service), filesystem_pool: Some(ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 20286250-f108-4895-96f3-b52cf57ac2de (service), filesystem_pool: Some(ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8312dd7c-a23c-41d7-a3d9-cf6bec2e98be (service), filesystem_pool: Some(ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External } } } }, OmicronZoneConfig { id: b30880c7-fcb2-44f2-86ba-36281976501d (service), filesystem_pool: Some(ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External } } } }, OmicronZoneConfig { id: c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7 (service), filesystem_pool: Some(ZpoolName { id: 2d68dcb6-83b9-430c-b8d8-fa955e9efd1b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2d68dcb6-83b9-430c-b8d8-fa955e9efd1b (zpool), kind: External } } } }, OmicronZoneConfig { id: 774d19ef-bccd-4a82-a5c4-90f380997526 (service), filesystem_pool: Some(ZpoolName { id: b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 54590321-411c-48c3-8da3-89fa2437b722 (service), filesystem_pool: Some(ZpoolName { id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
10462024-11-19T05:52:29.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34438
10472024-11-19T05:52:29.497ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8dc16782-541b-438c-82ef-18d39164ba3b, dataset_name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10482024-11-19T05:52:29.497ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 8dc16782-541b-438c-82ef-18d39164ba3b, dataset_name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: InternalDns }, responder: ... }
10492024-11-19T05:52:29.570ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f25e6486-b7ba-41a0-97d7-aa40f3d70ad4, dataset_name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10502024-11-19T05:52:29.570ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f25e6486-b7ba-41a0-97d7-aa40f3d70ad4, dataset_name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10512024-11-19T05:52:29.650ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c51e8d3b-11f8-41aa-a061-9ba80e14ea5e, dataset_name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10522024-11-19T05:52:29.650ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c51e8d3b-11f8-41aa-a061-9ba80e14ea5e, dataset_name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10532024-11-19T05:52:29.711ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1da99676-0ffd-4a85-a090-0f82be6d0ccd, dataset_name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10542024-11-19T05:52:29.711ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1da99676-0ffd-4a85-a090-0f82be6d0ccd, dataset_name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: Cockroach }, responder: ... }
10552024-11-19T05:52:29.760ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8a5e4adf-7dd3-4aa0-a818-be5781f94737, dataset_name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10562024-11-19T05:52:29.760ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 8a5e4adf-7dd3-4aa0-a818-be5781f94737, dataset_name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10572024-11-19T05:52:29.805ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cb7977f7-7ade-43f2-8efa-e915b4c02658, dataset_name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10582024-11-19T05:52:29.805ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: cb7977f7-7ade-43f2-8efa-e915b4c02658, dataset_name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10592024-11-19T05:52:29.847ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 426e44b0-e306-4318-9242-c63415399f23, dataset_name: DatasetName { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10602024-11-19T05:52:29.847ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 426e44b0-e306-4318-9242-c63415399f23, dataset_name: DatasetName { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10612024-11-19T05:52:29.891ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 537d1a13-24cc-46d5-bfb0-4d8742745e9c, dataset_name: DatasetName { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10622024-11-19T05:52:29.891ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 537d1a13-24cc-46d5-bfb0-4d8742745e9c, dataset_name: DatasetName { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, kind: Cockroach }, responder: ... }
10632024-11-19T05:52:29.938ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c29d6cd6-2a42-4173-b7b2-1125c4e42dc9, dataset_name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10642024-11-19T05:52:29.938ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c29d6cd6-2a42-4173-b7b2-1125c4e42dc9, dataset_name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10652024-11-19T05:52:30.045ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bb4d79db-b332-4dd4-8e52-fcecf48e448d, dataset_name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10662024-11-19T05:52:30.045ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: bb4d79db-b332-4dd4-8e52-fcecf48e448d, dataset_name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10672024-11-19T05:52:30.093ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 38ebcc96-958b-4c68-8f89-a38fd71ccbb9, dataset_name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
10682024-11-19T05:52:30.093ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 38ebcc96-958b-4c68-8f89-a38fd71ccbb9, dataset_name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10692024-11-19T05:52:30.135ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5b86554c-1fdb-4572-96a3-d35456303040, dataset_name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10702024-11-19T05:52:30.135ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 5b86554c-1fdb-4572-96a3-d35456303040, dataset_name: DatasetName { pool_name: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, kind: Crucible }, responder: ... }
10712024-11-19T05:52:30.183ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 68bb655e-6fb1-48fe-87bc-8a66c2dd37d6, dataset_name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10722024-11-19T05:52:30.183ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 68bb655e-6fb1-48fe-87bc-8a66c2dd37d6, dataset_name: DatasetName { pool_name: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, kind: Crucible }, responder: ... }
10732024-11-19T05:52:30.231ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9a256def-dc34-4e28-a778-837b612c3e75, dataset_name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10742024-11-19T05:52:30.231ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 9a256def-dc34-4e28-a778-837b612c3e75, dataset_name: DatasetName { pool_name: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, kind: Crucible }, responder: ... }
10752024-11-19T05:52:30.285ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 20286250-f108-4895-96f3-b52cf57ac2de, dataset_name: DatasetName { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10762024-11-19T05:52:30.285ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 20286250-f108-4895-96f3-b52cf57ac2de, dataset_name: DatasetName { pool_name: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, kind: Crucible }, responder: ... }
10772024-11-19T05:52:30.335ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8312dd7c-a23c-41d7-a3d9-cf6bec2e98be, dataset_name: DatasetName { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10782024-11-19T05:52:30.335ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 8312dd7c-a23c-41d7-a3d9-cf6bec2e98be, dataset_name: DatasetName { pool_name: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, kind: Crucible }, responder: ... }
10792024-11-19T05:52:30.414ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b30880c7-fcb2-44f2-86ba-36281976501d, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10802024-11-19T05:52:30.414ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b30880c7-fcb2-44f2-86ba-36281976501d, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External }, kind: Crucible }, responder: ... }
10812024-11-19T05:52:30.471ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d68dcb6-83b9-430c-b8d8-fa955e9efd1b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10822024-11-19T05:52:30.471ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d68dcb6-83b9-430c-b8d8-fa955e9efd1b (zpool), kind: External }, kind: Crucible }, responder: ... }
10832024-11-19T05:52:30.523ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 774d19ef-bccd-4a82-a5c4-90f380997526, dataset_name: DatasetName { pool_name: ZpoolName { id: b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10842024-11-19T05:52:30.523ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 774d19ef-bccd-4a82-a5c4-90f380997526, dataset_name: DatasetName { pool_name: ZpoolName { id: b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9 (zpool), kind: External }, kind: Crucible }, responder: ... }
10852024-11-19T05:52:30.566ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 54590321-411c-48c3-8da3-89fa2437b722, dataset_name: DatasetName { pool_name: ZpoolName { id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10862024-11-19T05:52:30.566ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 54590321-411c-48c3-8da3-89fa2437b722, dataset_name: DatasetName { pool_name: ZpoolName { id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool), kind: External }, kind: Crucible }, responder: ... }
10872024-11-19T05:52:30.612ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10882024-11-19T05:52:30.612ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/omicron-zones.json file = common/src/ledger.rs:177
10892024-11-19T05:52:30.612ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/omicron-zones.json file = common/src/ledger.rs:177
10902024-11-19T05:52:30.612ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10912024-11-19T05:52:30.745ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10922024-11-19T05:52:30.746ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10932024-11-19T05:52:30.757ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10942024-11-19T05:52:30.759ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10952024-11-19T05:52:30.760ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10962024-11-19T05:52:30.789ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10972024-11-19T05:52:30.789ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10982024-11-19T05:52:30.789ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10992024-11-19T05:52:30.789ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11002024-11-19T05:52:30.789ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11012024-11-19T05:52:30.791ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11022024-11-19T05:52:30.945ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11032024-11-19T05:52:30.945ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11042024-11-19T05:52:31.018ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11052024-11-19T05:52:31.018ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11062024-11-19T05:52:31.018ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11072024-11-19T05:52:31.018ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11082024-11-19T05:52:31.018ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11092024-11-19T05:52:31.018ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11102024-11-19T05:52:31.019ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722 file = illumos-utils/src/zone.rs:325
11112024-11-19T05:52:31.025ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc file = illumos-utils/src/zone.rs:325
11122024-11-19T05:52:31.029ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7 file = illumos-utils/src/zone.rs:325
11132024-11-19T05:52:31.034ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9 file = illumos-utils/src/zone.rs:325
11142024-11-19T05:52:31.039ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e file = illumos-utils/src/zone.rs:325
11152024-11-19T05:52:31.044ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966 file = illumos-utils/src/zone.rs:325
11162024-11-19T05:52:31.050ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040 file = illumos-utils/src/zone.rs:325
11172024-11-19T05:52:31.193ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722 file = illumos-utils/src/zone.rs:363
11182024-11-19T05:52:31.199ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc file = illumos-utils/src/zone.rs:363
11192024-11-19T05:52:31.204ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7 file = illumos-utils/src/zone.rs:363
11202024-11-19T05:52:31.208ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9 file = illumos-utils/src/zone.rs:363
11212024-11-19T05:52:31.213ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e file = illumos-utils/src/zone.rs:363
11222024-11-19T05:52:31.218ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966 file = illumos-utils/src/zone.rs:363
11232024-11-19T05:52:31.223ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040 file = illumos-utils/src/zone.rs:363
11242024-11-19T05:52:31.228ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6 file = illumos-utils/src/zone.rs:325
11252024-11-19T05:52:31.233ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de file = illumos-utils/src/zone.rs:325
11262024-11-19T05:52:31.238ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be file = illumos-utils/src/zone.rs:325
11272024-11-19T05:52:31.243ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d file = illumos-utils/src/zone.rs:325
11282024-11-19T05:52:31.248ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7 file = illumos-utils/src/zone.rs:325
11292024-11-19T05:52:31.253ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526 file = illumos-utils/src/zone.rs:325
11302024-11-19T05:52:31.260ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75 file = illumos-utils/src/zone.rs:325
11312024-11-19T05:52:31.267ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6 file = illumos-utils/src/zone.rs:363
11322024-11-19T05:52:31.274ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de file = illumos-utils/src/zone.rs:363
11332024-11-19T05:52:31.280ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be file = illumos-utils/src/zone.rs:363
11342024-11-19T05:52:31.286ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d file = illumos-utils/src/zone.rs:363
11352024-11-19T05:52:31.293ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7 file = illumos-utils/src/zone.rs:363
11362024-11-19T05:52:31.302ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526 file = illumos-utils/src/zone.rs:363
11372024-11-19T05:52:31.311ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75 file = illumos-utils/src/zone.rs:363
11382024-11-19T05:52:31.375ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11392024-11-19T05:52:31.428ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11402024-11-19T05:52:31.499ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11412024-11-19T05:52:31.566ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11422024-11-19T05:52:31.627ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11432024-11-19T05:52:31.630ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11442024-11-19T05:52:31.630ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11452024-11-19T05:52:31.685ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 246, 174]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11462024-11-19T05:52:31.685ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11472024-11-19T05:52:31.686ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11482024-11-19T05:52:31.686ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11492024-11-19T05:52:31.742ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 185, 99]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11502024-11-19T05:52:31.742ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11512024-11-19T05:52:31.744ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11522024-11-19T05:52:31.744ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11532024-11-19T05:52:31.798ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 137, 218]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11542024-11-19T05:52:31.798ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11552024-11-19T05:52:31.800ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11562024-11-19T05:52:31.800ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11572024-11-19T05:52:31.867ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 252, 101]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11582024-11-19T05:52:31.867ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11592024-11-19T05:52:31.870ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11602024-11-19T05:52:31.870ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11612024-11-19T05:52:31.990ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 173, 203]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11622024-11-19T05:52:31.990ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11632024-11-19T05:52:31.990ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
11642024-11-19T05:52:31.990ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
11652024-11-19T05:52:31.990ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
11662024-11-19T05:52:31.990ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
11672024-11-19T05:52:31.990ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
11682024-11-19T05:52:31.990ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
11692024-11-19T05:52:31.991ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
11702024-11-19T05:52:31.991ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
11712024-11-19T05:52:31.991ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
11722024-11-19T05:52:31.991ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
11732024-11-19T05:52:31.991ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
11742024-11-19T05:52:31.992ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
11752024-11-19T05:52:31.994ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11762024-11-19T05:52:31.994ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11772024-11-19T05:52:31.994ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
11782024-11-19T05:52:31.996ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
11792024-11-19T05:52:31.999ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
11802024-11-19T05:52:32.000ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11812024-11-19T05:52:32.000ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11822024-11-19T05:52:32.109ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11832024-11-19T05:52:32.485ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458 file = illumos-utils/src/zone.rs:325
11842024-11-19T05:52:32.544ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98 file = illumos-utils/src/zone.rs:325
11852024-11-19T05:52:32.710ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9 file = illumos-utils/src/zone.rs:325
11862024-11-19T05:52:32.759ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d file = illumos-utils/src/zone.rs:325
11872024-11-19T05:52:32.790ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_8318957c-506a-4355-8689-147ab934628e file = illumos-utils/src/zone.rs:325
11882024-11-19T05:52:32.822ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98 file = illumos-utils/src/zone.rs:363
11892024-11-19T05:52:32.830ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458 file = illumos-utils/src/zone.rs:363
11902024-11-19T05:52:32.839ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9 file = illumos-utils/src/zone.rs:363
11912024-11-19T05:52:32.848ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d file = illumos-utils/src/zone.rs:363
11922024-11-19T05:52:32.856ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_8318957c-506a-4355-8689-147ab934628e file = illumos-utils/src/zone.rs:363
11932024-11-19T05:52:37.457ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40967
11942024-11-19T05:52:37.476ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 511 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40967 req_id = 9e06cd0b-c70a-4251-a2c0-db639daba52f response_code = 200 uri = /baseboard
11952024-11-19T05:52:37.740ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11962024-11-19T05:52:37.740ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966
11972024-11-19T05:52:37.973ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11982024-11-19T05:52:37.973ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e
11992024-11-19T05:52:38.140ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_685f3f58-b5f9-4e42-8994-bdac247f87cd/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7c881e8d-3135-410b-9dff-464877b55a47'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12002024-11-19T05:52:38.140ZINFOSledAgent (ServiceManager): Booting oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722
12012024-11-19T05:52:38.416ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b94b817f-675d-49a5-b1c9-b8c4fb8b401d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e3b4bca5-0190-4e95-9733-1f01cac7282e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12022024-11-19T05:52:38.416ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be
12032024-11-19T05:52:38.448ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c5fdd794-3bc8-49cb-89e3-b36cc4eb9892/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='26acc1bc-0cba-4287-b22f-68e0918a326a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12042024-11-19T05:52:38.449ZINFOSledAgent (ServiceManager): Booting oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de
12052024-11-19T05:52:43.417ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_35a1f44b-de46-41ee-ad1e-96313ecc15b9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a92933fc-11b6-4a53-b8d6-9a4ef3abdb1c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12062024-11-19T05:52:43.417ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75
12072024-11-19T05:52:43.444ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_5c871af8-68dd-4136-bfd3-234cd1e72e1e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='726cf04d-441b-42ed-ab0f-353919bdabce'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12082024-11-19T05:52:43.444ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='51583aa7-df09-4f50-81a5-11091b78e4e7'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12092024-11-19T05:52:43.444ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d
12102024-11-19T05:52:43.454ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2d68dcb6-83b9-430c-b8d8-fa955e9efd1b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9043d6fa-6e60-4fdb-82e5-4679879ed148'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12112024-11-19T05:52:43.455ZINFOSledAgent (ServiceManager): Booting oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526
12122024-11-19T05:52:43.468ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7
12132024-11-19T05:52:43.952ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12142024-11-19T05:52:43.953ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7
12152024-11-19T05:52:44.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966") failed: Property not found. retry in 44.116551ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966
12162024-11-19T05:52:44.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722") failed: Property not found. retry in 40.027162ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722
12172024-11-19T05:52:44.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966") failed: Property not found. retry in 107.29173ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966
12182024-11-19T05:52:44.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722") failed: Property not found. retry in 116.537027ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722
12192024-11-19T05:52:44.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be") failed: Property not found. retry in 69.398029ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be
12202024-11-19T05:52:44.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526") failed: Property not found. retry in 66.468269ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526
12212024-11-19T05:52:44.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e") failed: Property not found. retry in 60.600214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e
12222024-11-19T05:52:44.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de") failed: Property not found. retry in 62.654492ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de
12232024-11-19T05:52:44.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7") failed: Property not found. retry in 49.328331ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7
12242024-11-19T05:52:44.497ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8f726703-f78a-4246-88d2-b12195677e7c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='8c7610f7-9bd9-48fb-a999-1c7b3316375e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12252024-11-19T05:52:44.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75") failed: Property not found. retry in 65.495214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75
12262024-11-19T05:52:44.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7") failed: Property not found. retry in 55.674942ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7
12272024-11-19T05:52:44.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e") failed: Property not found. retry in 126.441331ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e
12282024-11-19T05:52:44.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966") failed: Property not found. retry in 206.207229ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966
12292024-11-19T05:52:44.592ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040
12302024-11-19T05:52:44.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de") failed: Property not found. retry in 137.398705ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de
12312024-11-19T05:52:45.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be") failed: Property not found. retry in 53.764561ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be
12322024-11-19T05:52:45.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d") failed: Property not found. retry in 68.616612ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d
12332024-11-19T05:52:45.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7") failed: Property not found. retry in 103.774911ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7
12342024-11-19T05:52:45.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526") failed: Property not found. retry in 101.946951ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526
12352024-11-19T05:52:45.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75") failed: Property not found. retry in 55.078267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75
12362024-11-19T05:52:45.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722") failed: Property not found. retry in 289.398949ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722
12372024-11-19T05:52:45.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7") failed: Property not found. retry in 147.314919ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7
12382024-11-19T05:52:45.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e") failed: Property not found. retry in 142.864155ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e
12392024-11-19T05:52:45.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966") failed: Property not found. retry in 228.147849ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966
12402024-11-19T05:52:45.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de") failed: Property not found. retry in 261.277553ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de
12412024-11-19T05:52:45.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be") failed: Property not found. retry in 208.384927ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be
12422024-11-19T05:52:45.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d") failed: Property not found. retry in 57.535263ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d
12432024-11-19T05:52:45.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7") failed: Property not found. retry in 257.349288ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7
12442024-11-19T05:52:45.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526") failed: Property not found. retry in 257.546778ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526
12452024-11-19T05:52:45.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75") failed: Property not found. retry in 283.384261ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75
12462024-11-19T05:52:45.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d") failed: Property not found. retry in 112.379204ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d
12472024-11-19T05:52:45.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7") failed: Property not found. retry in 160.394284ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7
12482024-11-19T05:52:45.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e") failed: Property not found. retry in 359.652961ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e
12492024-11-19T05:52:45.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722") failed: Property not found. retry in 530.370651ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722
12502024-11-19T05:52:45.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040") failed: Property not found. retry in 61.61206ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040
12512024-11-19T05:52:45.665ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='da1ff28e-ea87-4bc7-83f5-781f17826bcc'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12522024-11-19T05:52:45.665ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc
12532024-11-19T05:52:45.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966") failed: Property not found. retry in 795.046317ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966
12542024-11-19T05:52:45.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040") failed: Property not found. retry in 86.872797ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040
12552024-11-19T05:52:45.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d") failed: Property not found. retry in 245.633904ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d
12562024-11-19T05:52:45.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be") failed: Property not found. retry in 556.348719ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be
12572024-11-19T05:52:45.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de") failed: Property not found. retry in 484.784857ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de
12582024-11-19T05:52:45.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7") failed: Property not found. retry in 449.981087ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7
12592024-11-19T05:52:45.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7") failed: Property not found. retry in 206.269665ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7
12602024-11-19T05:52:45.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526") failed: Property not found. retry in 238.178892ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526
12612024-11-19T05:52:45.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040") failed: Property not found. retry in 284.330886ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040
12622024-11-19T05:52:45.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75") failed: Property not found. retry in 357.818705ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75
12632024-11-19T05:52:45.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc") failed: Property not found. retry in 71.477013ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc
12642024-11-19T05:52:45.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e") failed: Property not found. retry in 889.257739ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e
12652024-11-19T05:52:45.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d") failed: Property not found. retry in 1.191026725s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d
12662024-11-19T05:52:46.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc") failed: Property not found. retry in 81.430831ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc
12672024-11-19T05:52:46.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7") failed: Property not found. retry in 807.245657ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7
12682024-11-19T05:52:46.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526") failed: Property not found. retry in 773.725727ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526
12692024-11-19T05:52:46.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc") failed: Property not found. retry in 231.580588ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc
12702024-11-19T05:52:46.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040") failed: Property not found. retry in 370.080809ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040
12712024-11-19T05:52:46.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722") failed: Property not found. retry in 463.679958ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722
12722024-11-19T05:52:46.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75") failed: Property not found. retry in 568.939297ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75
12732024-11-19T05:52:46.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7") failed: Property not found. retry in 683.244212ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7
12742024-11-19T05:52:46.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de") failed: Property not found. retry in 801.338421ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de
12752024-11-19T05:52:46.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be") failed: Property not found. retry in 1.036804802s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be
12762024-11-19T05:52:46.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc") failed: Property not found. retry in 224.714668ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc
12772024-11-19T05:52:46.404ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12782024-11-19T05:52:46.404ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d
12792024-11-19T05:52:46.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040") failed: Property not found. retry in 1.005164182s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040
12802024-11-19T05:52:46.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966") failed: Property not found. retry in 1.472274287s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966
12812024-11-19T05:52:46.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc") failed: Property not found. retry in 927.193671ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc
12822024-11-19T05:52:46.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722") failed: Property not found. retry in 1.32959136s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722
12832024-11-19T05:52:46.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d") failed: Property not found. retry in 68.13406ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d
12842024-11-19T05:52:46.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d") failed: Property not found. retry in 100.04522ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d
12852024-11-19T05:52:46.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7") failed: Property not found. retry in 1.007783811s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7
12862024-11-19T05:52:46.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526") failed: Property not found. retry in 855.48511ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526
12872024-11-19T05:52:47.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75") failed: Property not found. retry in 973.510202ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75
12882024-11-19T05:52:47.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d") failed: Property not found. retry in 122.931669ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d
12892024-11-19T05:52:47.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7") failed: Property not found. retry in 1.050720245s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7
12902024-11-19T05:52:47.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e") failed: Property not found. retry in 1.472140293s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e
12912024-11-19T05:52:47.098ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7643f6a6-8f76-47aa-b2e9-7d8dbb1c8ca2'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12922024-11-19T05:52:47.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de") failed: Property not found. retry in 1.162011775s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de
12932024-11-19T05:52:47.129ZINFOSledAgent (ServiceManager): Booting oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6
12942024-11-19T05:52:47.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d") failed: Property not found. retry in 433.213264ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d
12952024-11-19T05:52:47.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d") failed: Property not found. retry in 1.311834011s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d
12962024-11-19T05:52:47.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be") failed: Property not found. retry in 1.048318406s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be
12972024-11-19T05:52:47.386ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12982024-11-19T05:52:47.386ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9
12992024-11-19T05:52:47.511ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.481863683s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
13002024-11-19T05:52:47.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040") failed: Property not found. retry in 1.478607588s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040
13012024-11-19T05:52:47.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6") failed: Property not found. retry in 72.732867ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6
13022024-11-19T05:52:47.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc") failed: Property not found. retry in 604.482017ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc
13032024-11-19T05:52:47.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d") failed: Property not found. retry in 1.113285402s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d
13042024-11-19T05:52:47.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6") failed: Property not found. retry in 98.532154ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6
13052024-11-19T05:52:47.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9") failed: Property not found. retry in 42.983066ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9
13062024-11-19T05:52:47.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9") failed: Property not found. retry in 118.799391ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9
13072024-11-19T05:52:47.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6") failed: Property not found. retry in 193.99882ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6
13082024-11-19T05:52:47.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526") failed: Property not found. retry in 900.174944ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526
13092024-11-19T05:52:47.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9") failed: Property not found. retry in 250.703412ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9
13102024-11-19T05:52:47.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7") failed: Property not found. retry in 1.405373212s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7
13112024-11-19T05:52:47.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6") failed: Property not found. retry in 412.685563ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6
13122024-11-19T05:52:47.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722") failed: Property not found. retry in 654.716168ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722
13132024-11-19T05:52:48.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966") failed: Property not found. retry in 828.698439ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966
13142024-11-19T05:52:48.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75") failed: Property not found. retry in 1.48587521s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75
13152024-11-19T05:52:48.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7") failed: Property not found. retry in 1.152005453s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7
13162024-11-19T05:52:48.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc") failed: Property not found. retry in 1.496668964s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc
13172024-11-19T05:52:48.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9") failed: Property not found. retry in 473.641892ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9
13182024-11-19T05:52:48.216ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_8318957c-506a-4355-8689-147ab934628e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13192024-11-19T05:52:48.217ZINFOSledAgent (ServiceManager): Booting oxz_nexus_8318957c-506a-4355-8689-147ab934628e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_8318957c-506a-4355-8689-147ab934628e
13202024-11-19T05:52:48.225ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13212024-11-19T05:52:48.225ZINFOSledAgent (ServiceManager): Booting oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98
13222024-11-19T05:52:48.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de") failed: Property not found. retry in 1.340398177s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de
13232024-11-19T05:52:48.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6") failed: Property not found. retry in 624.334429ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6
13242024-11-19T05:52:48.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be") failed: Property not found. retry in 551.772067ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be
13252024-11-19T05:52:48.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8318957c-506a-4355-8689-147ab934628e") failed: Property not found. retry in 38.805744ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8318957c-506a-4355-8689-147ab934628e
13262024-11-19T05:52:48.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d") failed: Property not found. retry in 1.086827553s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d
13272024-11-19T05:52:48.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98") failed: Property not found. retry in 57.884714ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98
13282024-11-19T05:52:48.549ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13292024-11-19T05:52:48.549ZINFOSledAgent (ServiceManager): Booting oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458
13302024-11-19T05:52:48.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8318957c-506a-4355-8689-147ab934628e") failed: Property not found. retry in 53.027333ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8318957c-506a-4355-8689-147ab934628e
13312024-11-19T05:52:48.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e") failed: Property not found. retry in 1.337061456s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e
13322024-11-19T05:52:48.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98") failed: Property not found. retry in 142.389338ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98
13332024-11-19T05:52:48.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8318957c-506a-4355-8689-147ab934628e") failed: Property not found. retry in 207.963018ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8318957c-506a-4355-8689-147ab934628e
13342024-11-19T05:52:48.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722") failed: Property not found. retry in 565.734681ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722
13352024-11-19T05:52:48.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9") failed: Property not found. retry in 1.09235019s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9
13362024-11-19T05:52:48.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526") failed: Property not found. retry in 683.441623ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526
13372024-11-19T05:52:48.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d") failed: Property not found. retry in 501.961709ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d
13382024-11-19T05:52:48.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98") failed: Property not found. retry in 282.844074ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98
13392024-11-19T05:52:48.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8318957c-506a-4355-8689-147ab934628e") failed: Property not found. retry in 560.33294ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8318957c-506a-4355-8689-147ab934628e
13402024-11-19T05:52:48.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458") failed: Property not found. retry in 60.001034ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458
13412024-11-19T05:52:48.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966") failed: Property not found. retry in 893.211924ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966
13422024-11-19T05:52:48.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458") failed: Property not found. retry in 87.472968ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458
13432024-11-19T05:52:49.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be") failed: Property not found. retry in 1.25710596s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be
13442024-11-19T05:52:49.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040") failed: Property not found. retry in 505.70908ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040
13452024-11-19T05:52:49.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6") failed: Property not found. retry in 1.381627544s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6
13462024-11-19T05:52:49.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458") failed: Property not found. retry in 108.774368ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458
13472024-11-19T05:52:49.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98") failed: Property not found. retry in 344.418105ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98
13482024-11-19T05:52:49.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458") failed: Property not found. retry in 215.235793ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458
13492024-11-19T05:52:49.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722") failed: Property not found. retry in 806.264544ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722
13502024-11-19T05:52:49.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d") failed: Property not found. retry in 1.361103998s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d
13512024-11-19T05:52:49.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7") failed: Property not found. retry in 1.18136918s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7
13522024-11-19T05:52:49.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7") failed: Property not found. retry in 1.029486028s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7
13532024-11-19T05:52:49.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458") failed: Property not found. retry in 1.02404866s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458
13542024-11-19T05:52:49.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8318957c-506a-4355-8689-147ab934628e") failed: Property not found. retry in 1.084055603s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8318957c-506a-4355-8689-147ab934628e
13552024-11-19T05:52:49.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526") failed: Property not found. retry in 1.308898124s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526
13562024-11-19T05:52:49.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98") failed: Property not found. retry in 433.451048ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98
13572024-11-19T05:52:49.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75") failed: Property not found. retry in 1.041395724s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75
13582024-11-19T05:52:49.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040") failed: Property not found. retry in 1.467513417s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040
13592024-11-19T05:52:49.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d") failed: Property not found. retry in 805.462272ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d
13602024-11-19T05:52:49.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de") failed: Property not found. retry in 1.362467782s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de
13612024-11-19T05:52:49.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc") failed: Property not found. retry in 714.773706ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc
13622024-11-19T05:52:49.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9") failed: Property not found. retry in 820.735641ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9
13632024-11-19T05:52:49.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966") failed: Property not found. retry in 1.215680099s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966
13642024-11-19T05:52:49.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e") failed: Property not found. retry in 1.388142413s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e
13652024-11-19T05:52:49.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98") failed: Property not found. retry in 711.490707ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98
13662024-11-19T05:52:50.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722") failed: Property not found. retry in 920.624937ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722
13672024-11-19T05:52:50.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be") failed: Property not found. retry in 669.640753ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be
13682024-11-19T05:52:50.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7") failed: Property not found. retry in 638.972399ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7
13692024-11-19T05:52:50.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc") failed: Property not found. retry in 560.993303ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc
13702024-11-19T05:52:50.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6") failed: Property not found. retry in 973.05178ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6
13712024-11-19T05:52:50.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d") failed: Property not found. retry in 1.115902127s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d
13722024-11-19T05:52:50.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458") failed: Property not found. retry in 1.314705002s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458
13732024-11-19T05:52:50.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7") failed: Property not found. retry in 874.036235ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7
13742024-11-19T05:52:50.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8318957c-506a-4355-8689-147ab934628e") failed: Property not found. retry in 926.508305ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8318957c-506a-4355-8689-147ab934628e
13752024-11-19T05:52:50.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75") failed: Property not found. retry in 1.48508423s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75
13762024-11-19T05:52:50.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9") failed: Property not found. retry in 523.316724ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9
13772024-11-19T05:52:50.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d") failed: Property not found. retry in 1.494660565s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d
13782024-11-19T05:52:50.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98") failed: Property not found. retry in 1.273993282s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98
13792024-11-19T05:52:50.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526") failed: Property not found. retry in 1.10100253s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526
13802024-11-19T05:52:50.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be") failed: Property not found. retry in 1.03169873s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be
13812024-11-19T05:52:50.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722") failed: Property not found. retry in 1.01879726s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722
13822024-11-19T05:52:51.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc") failed: Property not found. retry in 1.486638127s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc
13832024-11-19T05:52:51.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040") failed: Property not found. retry in 1.301291659s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040
13842024-11-19T05:52:51.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de") failed: Property not found. retry in 587.261791ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de
13852024-11-19T05:52:51.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7") failed: Property not found. retry in 884.271624ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7
13862024-11-19T05:52:51.061ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13872024-11-19T05:52:51.065ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9
13882024-11-19T05:52:51.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966") failed: Property not found. retry in 644.587354ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966
13892024-11-19T05:52:51.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9") failed: Property not found. retry in 928.766938ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9
13902024-11-19T05:52:51.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e") failed: Property not found. retry in 634.732623ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e
13912024-11-19T05:52:51.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9") failed: Property not found. retry in 64.233702ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9
13922024-11-19T05:52:51.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7") failed: Property not found. retry in 666.786255ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7
13932024-11-19T05:52:51.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6") failed: Property not found. retry in 1.29732408s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6
13942024-11-19T05:52:51.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9") failed: Property not found. retry in 107.687062ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9
13952024-11-19T05:52:51.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8318957c-506a-4355-8689-147ab934628e") failed: Property not found. retry in 612.915202ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8318957c-506a-4355-8689-147ab934628e
13962024-11-19T05:52:51.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9") failed: Property not found. retry in 146.024731ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9
13972024-11-19T05:52:51.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d") failed: Property not found. retry in 1.259533256s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d
13982024-11-19T05:52:51.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de") failed: Property not found. retry in 1.143482209s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de
13992024-11-19T05:52:51.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9") failed: Property not found. retry in 553.392749ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9
14002024-11-19T05:52:51.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966") failed: Property not found. retry in 1.376167417s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966
14012024-11-19T05:52:51.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458") failed: Property not found. retry in 1.46552965s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458
14022024-11-19T05:52:51.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526") failed: Property not found. retry in 1.435789901s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526
14032024-11-19T05:52:51.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7") failed: Property not found. retry in 1.309976931s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7
14042024-11-19T05:52:51.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98") failed: Property not found. retry in 522.683595ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98
14052024-11-19T05:52:51.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e") failed: Property not found. retry in 965.268803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e
14062024-11-19T05:52:52.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be") failed: Property not found. retry in 833.878292ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be
14072024-11-19T05:52:52.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722") failed: Property not found. retry in 731.793502ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722
14082024-11-19T05:52:52.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75") failed: Property not found. retry in 965.143063ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75
14092024-11-19T05:52:52.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7") failed: Property not found. retry in 859.026923ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7
14102024-11-19T05:52:52.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9") failed: Property not found. retry in 996.747558ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9
14112024-11-19T05:52:52.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8318957c-506a-4355-8689-147ab934628e") failed: Property not found. retry in 1.160437143s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8318957c-506a-4355-8689-147ab934628e
14122024-11-19T05:52:52.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d") failed: Property not found. retry in 779.912173ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d
14132024-11-19T05:52:52.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9") failed: Property not found. retry in 1.077185197s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9
14142024-11-19T05:52:52.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040") failed: Property not found. retry in 1.100021195s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040
14152024-11-19T05:52:52.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc") failed: Property not found. retry in 1.198046525s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc
14162024-11-19T05:52:52.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98") failed: Property not found. retry in 1.123216577s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98
14172024-11-19T05:52:52.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6") failed: Property not found. retry in 1.03964221s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6
14182024-11-19T05:52:52.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722") failed: Property not found. retry in 1.175557035s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722
14192024-11-19T05:52:52.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de") failed: Property not found. retry in 560.061133ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de
14202024-11-19T05:52:52.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be") failed: Property not found. retry in 781.692647ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be
14212024-11-19T05:52:52.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d") failed: Property not found. retry in 684.848157ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d
14222024-11-19T05:52:52.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7") failed: Property not found. retry in 783.04371ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7
14232024-11-19T05:52:52.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d") failed: Property not found. retry in 1.129595864s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d
14242024-11-19T05:52:52.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e") failed: Property not found. retry in 1.05712858s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e
14252024-11-19T05:52:53.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9") failed: Property not found. retry in 1.063414846s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9
14262024-11-19T05:52:53.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966") failed: Property not found. retry in 1.280528673s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966
14272024-11-19T05:52:53.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75") failed: Property not found. retry in 559.654166ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75
14282024-11-19T05:52:53.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7") failed: Property not found. retry in 591.649187ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7
14292024-11-19T05:52:53.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8318957c-506a-4355-8689-147ab934628e") failed: Property not found. retry in 1.389556944s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8318957c-506a-4355-8689-147ab934628e
14302024-11-19T05:52:53.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458") failed: Property not found. retry in 1.295532673s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458
14312024-11-19T05:52:53.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526") failed: Property not found. retry in 1.401511565s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526
14322024-11-19T05:52:53.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de") failed: Property not found. retry in 719.714917ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de
14332024-11-19T05:52:53.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9") failed: Property not found. retry in 725.034872ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9
14342024-11-19T05:52:53.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040") failed: Property not found. retry in 910.789973ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040
14352024-11-19T05:52:53.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d") failed: Property not found. retry in 1.108352395s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d
14362024-11-19T05:52:53.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be") failed: Property not found. retry in 1.18399395s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be
14372024-11-19T05:52:53.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98") failed: Property not found. retry in 1.311115277s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98
14382024-11-19T05:52:53.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc") failed: Property not found. retry in 535.097952ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc
14392024-11-19T05:52:53.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7") failed: Property not found. retry in 512.203738ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7
14402024-11-19T05:52:53.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6") failed: Property not found. retry in 793.482524ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6
14412024-11-19T05:52:53.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75") failed: Property not found. retry in 1.162294659s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75
14422024-11-19T05:52:53.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7") failed: Property not found. retry in 993.793994ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7
14432024-11-19T05:52:53.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722") failed: Property not found. retry in 1.486169793s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722
14442024-11-19T05:52:54.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e") failed: Property not found. retry in 784.517979ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e
14452024-11-19T05:52:54.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d") failed: Property not found. retry in 710.40893ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d
14462024-11-19T05:52:54.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de") failed: Property not found. retry in 970.533125ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de
14472024-11-19T05:52:54.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9") failed: Property not found. retry in 1.115850714s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9
14482024-11-19T05:52:54.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc") failed: Property not found. retry in 1.239242714s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc
14492024-11-19T05:52:54.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7") failed: Property not found. retry in 864.981531ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7
14502024-11-19T05:52:54.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9") failed: Property not found. retry in 856.455488ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9
14512024-11-19T05:52:54.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040") failed: Property not found. retry in 545.965817ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040
14522024-11-19T05:52:54.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966") failed: Property not found. retry in 623.424535ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966
14532024-11-19T05:52:54.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6") failed: Property not found. retry in 1.082461879s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6
14542024-11-19T05:52:54.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458") failed: Property not found. retry in 1.323340543s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458
14552024-11-19T05:52:54.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d") failed: Property not found. retry in 1.397256756s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d
14562024-11-19T05:52:54.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8318957c-506a-4355-8689-147ab934628e") failed: Property not found. retry in 1.07792574s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8318957c-506a-4355-8689-147ab934628e
14572024-11-19T05:52:54.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526") failed: Property not found. retry in 778.492404ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526
14582024-11-19T05:52:54.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d") failed: Property not found. retry in 749.277668ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d
14592024-11-19T05:52:54.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e") failed: Property not found. retry in 1.049349216s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e
14602024-11-19T05:52:54.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be") failed: Property not found. retry in 1.349832865s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be
14612024-11-19T05:52:54.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7") failed: Property not found. retry in 596.76571ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7
14622024-11-19T05:52:54.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040") failed: Property not found. retry in 658.388025ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040
14632024-11-19T05:52:54.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98") failed: Property not found. retry in 1.221290636s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98
14642024-11-19T05:52:55.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75") failed: Property not found. retry in 778.660905ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75
14652024-11-19T05:52:55.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de") failed: Property not found. retry in 1.182960928s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de
14662024-11-19T05:52:55.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7") failed: Property not found. retry in 1.076415653s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7
14672024-11-19T05:52:55.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966") failed: Property not found. retry in 1.408620718s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966
14682024-11-19T05:52:55.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9") failed: Property not found. retry in 872.016564ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9
14692024-11-19T05:52:55.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9") failed: Property not found. retry in 689.581893ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9
14702024-11-19T05:52:55.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722") failed: Property not found. retry in 897.229363ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722
14712024-11-19T05:52:55.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7") failed: Property not found. retry in 993.416937ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7
14722024-11-19T05:52:55.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc") failed: Property not found. retry in 1.358491581s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc
14732024-11-19T05:52:55.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526") failed: Property not found. retry in 521.280953ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526
14742024-11-19T05:52:55.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d") failed: Property not found. retry in 1.284667546s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d
14752024-11-19T05:52:55.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040") failed: Property not found. retry in 691.110551ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040
14762024-11-19T05:52:55.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6") failed: Property not found. retry in 1.476316953s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6
14772024-11-19T05:52:55.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8318957c-506a-4355-8689-147ab934628e") failed: Property not found. retry in 1.493918286s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8318957c-506a-4355-8689-147ab934628e
14782024-11-19T05:52:55.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75") failed: Property not found. retry in 689.312418ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75
14792024-11-19T05:52:55.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e") failed: Property not found. retry in 1.296772518s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e
14802024-11-19T05:52:55.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9") failed: Property not found. retry in 1.076202043s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9
14812024-11-19T05:52:55.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458") failed: Property not found. retry in 656.111564ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458
14822024-11-19T05:52:56.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9") failed: Property not found. retry in 990.937974ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9
14832024-11-19T05:52:56.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d") failed: Property not found. retry in 1.199332509s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d
14842024-11-19T05:52:56.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526") failed: Property not found. retry in 664.818235ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526
14852024-11-19T05:52:56.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98") failed: Property not found. retry in 1.36145624s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98
14862024-11-19T05:52:56.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be") failed: Property not found. retry in 895.483744ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be
14872024-11-19T05:52:56.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7") failed: Property not found. retry in 1.15892475s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7
14882024-11-19T05:52:56.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de") failed: Property not found. retry in 1.498281962s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de
14892024-11-19T05:52:56.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040") failed: Property not found. retry in 883.497549ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040
14902024-11-19T05:52:56.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722") failed: Property not found. retry in 762.67078ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722
14912024-11-19T05:52:56.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7") failed: Property not found. retry in 533.312048ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7
14922024-11-19T05:52:56.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75") failed: Property not found. retry in 1.148773286s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75
14932024-11-19T05:52:56.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458") failed: Property not found. retry in 569.294234ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458
14942024-11-19T05:52:56.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526") failed: Property not found. retry in 595.907928ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526
14952024-11-19T05:52:56.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc") failed: Property not found. retry in 819.262461ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc
14962024-11-19T05:52:56.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d") failed: Property not found. retry in 1.15968939s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d
14972024-11-19T05:52:57.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9") failed: Property not found. retry in 1.103875432s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9
14982024-11-19T05:52:57.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7") failed: Property not found. retry in 1.255073532s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7
14992024-11-19T05:52:57.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9") failed: Property not found. retry in 622.188043ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9
15002024-11-19T05:52:57.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be") failed: Property not found. retry in 699.187425ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be
15012024-11-19T05:52:57.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722") failed: Property not found. retry in 592.056497ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722
15022024-11-19T05:52:57.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6") failed: Property not found. retry in 1.404441876s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6
15032024-11-19T05:52:57.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040") failed: Property not found. retry in 1.488619839s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040
15042024-11-19T05:52:57.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e") failed: Property not found. retry in 1.073122257s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e
15052024-11-19T05:52:57.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458") failed: Property not found. retry in 1.221609641s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458
15062024-11-19T05:52:57.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8318957c-506a-4355-8689-147ab934628e") failed: Property not found. retry in 1.123080905s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8318957c-506a-4355-8689-147ab934628e
15072024-11-19T05:52:57.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d") failed: Property not found. retry in 589.180994ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d
15082024-11-19T05:52:57.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526") failed: Property not found. retry in 1.112390439s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526
15092024-11-19T05:52:57.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7") failed: Property not found. retry in 943.966187ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7
15102024-11-19T05:52:57.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98") failed: Property not found. retry in 1.054818736s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98
15112024-11-19T05:52:57.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75") failed: Property not found. retry in 827.234658ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75
15122024-11-19T05:52:57.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc") failed: Property not found. retry in 844.978971ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc
15132024-11-19T05:52:57.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9") failed: Property not found. retry in 1.415446667s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9
15142024-11-19T05:52:57.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722") failed: Property not found. retry in 849.632538ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722
15152024-11-19T05:52:57.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de") failed: Property not found. retry in 878.205037ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de
15162024-11-19T05:52:57.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be") failed: Property not found. retry in 1.474744045s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be
15172024-11-19T05:52:57.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d") failed: Property not found. retry in 540.806244ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d
15182024-11-19T05:52:58.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d") failed: Property not found. retry in 788.805265ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d
15192024-11-19T05:52:58.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9") failed: Property not found. retry in 1.146993636s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9
15202024-11-19T05:52:58.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e") failed: Property not found. retry in 726.886924ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e
15212024-11-19T05:52:58.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7") failed: Property not found. retry in 732.451758ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7
15222024-11-19T05:52:58.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7") failed: Property not found. retry in 960.546025ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7
15232024-11-19T05:52:58.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8318957c-506a-4355-8689-147ab934628e") failed: Property not found. retry in 1.232842268s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8318957c-506a-4355-8689-147ab934628e
15242024-11-19T05:52:58.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458") failed: Property not found. retry in 1.400727703s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458
15252024-11-19T05:52:58.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d") failed: Property not found. retry in 901.714086ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d
15262024-11-19T05:52:58.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75") failed: Property not found. retry in 1.449855322s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75
15272024-11-19T05:52:58.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526") failed: Property not found. retry in 652.772625ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526
15282024-11-19T05:52:58.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc") failed: Property not found. retry in 1.101640045s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc
15292024-11-19T05:52:58.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6") failed: Property not found. retry in 598.813121ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6
15302024-11-19T05:52:58.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040") failed: Property not found. retry in 1.419282155s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040
15312024-11-19T05:52:58.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98") failed: Property not found. retry in 1.496943763s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98
15322024-11-19T05:52:58.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d") failed: Property not found. retry in 952.237561ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d
15332024-11-19T05:52:59.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e") failed: Property not found. retry in 1.153126202s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e
15342024-11-19T05:52:59.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9") failed: Property not found. retry in 1.081644469s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9
15352024-11-19T05:52:59.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526") failed: Property not found. retry in 1.318507948s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526
15362024-11-19T05:52:59.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6") failed: Property not found. retry in 1.103513986s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6
15372024-11-19T05:52:59.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9") failed: Property not found. retry in 1.211205336s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9
15382024-11-19T05:52:59.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be") failed: Property not found. retry in 601.507579ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be
15392024-11-19T05:52:59.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8318957c-506a-4355-8689-147ab934628e") failed: Property not found. retry in 1.39048358s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8318957c-506a-4355-8689-147ab934628e
15402024-11-19T05:52:59.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458") failed: Property not found. retry in 1.287325211s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458
15412024-11-19T05:52:59.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75") failed: Property not found. retry in 915.755248ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75
15422024-11-19T05:53:00.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9") failed: Property not found. retry in 553.013143ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9
15432024-11-19T05:53:01.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9") failed: Property not found. retry in 1.007588933s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9
15442024-11-19T05:53:02.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9") failed: Property not found. retry in 1.197451635s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9
15452024-11-19T05:53:03.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9") failed: Property not found. retry in 766.622392ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9
15462024-11-19T05:53:04.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9") failed: Property not found. retry in 688.315579ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9
15472024-11-19T05:53:04.955ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_54590321-411c-48c3-8da3-89fa2437b722
15482024-11-19T05:53:04.955ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_c29d6cd6-2a42-4173-b7b2-1125c4e42dc9
15492024-11-19T05:53:04.955ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_bb4d79db-b332-4dd4-8e52-fcecf48e448d
15502024-11-19T05:53:04.955ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_8318957c-506a-4355-8689-147ab934628e
15512024-11-19T05:53:04.955ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_3ad742bb-4404-4a65-bfcd-5935cc6c6458
15522024-11-19T05:53:04.955ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_da1ff28e-ea87-4bc7-83f5-781f17826bcc
15532024-11-19T05:53:04.955ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_6ca86e9a-8b40-46dd-b1ba-f8533c9f81e7
15542024-11-19T05:53:04.955ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_38ebcc96-958b-4c68-8f89-a38fd71ccbb9
15552024-11-19T05:53:04.955ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_7696d96b-ff75-4d64-9a41-983528504a2e
15562024-11-19T05:53:04.955ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_d54f3e43-0b89-49ad-b18d-35bf37245966
15572024-11-19T05:53:04.955ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_5b86554c-1fdb-4572-96a3-d35456303040
15582024-11-19T05:53:04.955ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_68bb655e-6fb1-48fe-87bc-8a66c2dd37d6
15592024-11-19T05:53:04.955ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_67225c0a-0a53-4e08-a753-a917553c7b98
15602024-11-19T05:53:04.955ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_20286250-f108-4895-96f3-b52cf57ac2de
15612024-11-19T05:53:04.955ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_8312dd7c-a23c-41d7-a3d9-cf6bec2e98be
15622024-11-19T05:53:04.955ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_b30880c7-fcb2-44f2-86ba-36281976501d
15632024-11-19T05:53:04.955ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_c5c4dc29-d6c5-4e59-9ee6-ed4f48fb92e7
15642024-11-19T05:53:04.955ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_774d19ef-bccd-4a82-a5c4-90f380997526
15652024-11-19T05:53:04.955ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_9a256def-dc34-4e28-a778-837b612c3e75
15662024-11-19T05:53:04.960ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15672024-11-19T05:53:04.962ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15682024-11-19T05:53:04.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35481417 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:34438 req_id = ce931960-c4fc-44d1-8a82-fbd01ae4727d response_code = 204 uri = /omicron-zones
15692024-11-19T05:53:05.036ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1448
15702024-11-19T05:53:05.046ZINFOSledAgent (RSS): Writing ledger to /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15712024-11-19T05:53:05.046ZINFOSledAgent (RSS): Writing ledger to /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15722024-11-19T05:53:05.312ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:787
15732024-11-19T05:53:05.321ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:799
15742024-11-19T05:53:05.353ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1013
15752024-11-19T05:53:06.241ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f37e9a5a-e62c-4f4c-b823-2a838c617a9c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
15762024-11-19T05:53:06.374ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f37e9a5a-e62c-4f4c-b823-2a838c617a9c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
15772024-11-19T05:53:06.500ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f37e9a5a-e62c-4f4c-b823-2a838c617a9c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
15782024-11-19T05:53:06.650ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f37e9a5a-e62c-4f4c-b823-2a838c617a9c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
15792024-11-19T05:53:06.868ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f37e9a5a-e62c-4f4c-b823-2a838c617a9c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
15802024-11-19T05:53:07.028ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f37e9a5a-e62c-4f4c-b823-2a838c617a9c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
15812024-11-19T05:53:07.254ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f37e9a5a-e62c-4f4c-b823-2a838c617a9c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
15822024-11-19T05:53:07.558ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58413
15832024-11-19T05:53:07.564ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 652 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58413 req_id = 8d2420d8-8c69-435a-976e-baa0bc2d6fa2 response_code = 200 uri = /baseboard
15842024-11-19T05:53:07.646ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f37e9a5a-e62c-4f4c-b823-2a838c617a9c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
15852024-11-19T05:53:08.005ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f37e9a5a-e62c-4f4c-b823-2a838c617a9c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
15862024-11-19T05:53:08.231ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 10.230196311s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
15872024-11-19T05:53:08.253ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f37e9a5a-e62c-4f4c-b823-2a838c617a9c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
15882024-11-19T05:53:08.740ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f37e9a5a-e62c-4f4c-b823-2a838c617a9c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
15892024-11-19T05:53:09.288ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f37e9a5a-e62c-4f4c-b823-2a838c617a9c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
15902024-11-19T05:53:09.920ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f37e9a5a-e62c-4f4c-b823-2a838c617a9c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
15912024-11-19T05:53:13.173ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d46c8553-a6f7-4cc8-80e6-11718f7cbe4f", "content-length": "173", "date": "Tue, 19 Nov 2024 05:53:13 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"f37e9a5a-e62c-4f4c-b823-2a838c617a9c\"", request_id: "d46c8553-a6f7-4cc8-80e6-11718f7cbe4f" } file = sled-agent/src/rack_setup/service.rs:1075
15922024-11-19T05:53:14.793ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "22b36b7b-269e-42cf-920b-ffe9518c20d0", "content-length": "173", "date": "Tue, 19 Nov 2024 05:53:14 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"f37e9a5a-e62c-4f4c-b823-2a838c617a9c\"", request_id: "22b36b7b-269e-42cf-920b-ffe9518c20d0" } file = sled-agent/src/rack_setup/service.rs:1075
15932024-11-19T05:53:17.452ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0aa3eb8c-4037-4563-bc8e-38064ea2432b", "content-length": "173", "date": "Tue, 19 Nov 2024 05:53:17 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"176942d8-6f67-414d-8390-55e992dfe909\"", request_id: "0aa3eb8c-4037-4563-bc8e-38064ea2432b" } file = sled-agent/src/rack_setup/service.rs:1075
15942024-11-19T05:53:20.290ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a4475be1-47cb-4e1e-90a6-6f976a024de7", "content-length": "173", "date": "Tue, 19 Nov 2024 05:53:19 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"176942d8-6f67-414d-8390-55e992dfe909\"", request_id: "a4475be1-47cb-4e1e-90a6-6f976a024de7" } file = sled-agent/src/rack_setup/service.rs:1075
15952024-11-19T05:53:22.983ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "693f2121-ac44-4d3a-8b4c-b0ae9764fc71", "content-length": "173", "date": "Tue, 19 Nov 2024 05:53:22 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"176942d8-6f67-414d-8390-55e992dfe909\"", request_id: "693f2121-ac44-4d3a-8b4c-b0ae9764fc71" } file = sled-agent/src/rack_setup/service.rs:1075
15962024-11-19T05:53:25.623ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "29c4fcae-13f8-4af9-b4b5-891a6cc56294", "content-length": "173", "date": "Tue, 19 Nov 2024 05:53:25 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"176942d8-6f67-414d-8390-55e992dfe909\"", request_id: "29c4fcae-13f8-4af9-b4b5-891a6cc56294" } file = sled-agent/src/rack_setup/service.rs:1075
15972024-11-19T05:53:25.968ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:42519 remote_addr = [fd00:1122:3344:101::d]:64799 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
15982024-11-19T05:53:26.006ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36250 local_addr = [fd00:1122:3344:101::1]:42519 method = GET remote_addr = [fd00:1122:3344:101::d]:64799 req_id = 7dcc9125-dd6a-46c9-a427-2d22b775ca04 response_code = 200 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 uri = /176942d8-6f67-414d-8390-55e992dfe909
15992024-11-19T05:53:28.767ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3f734785-1a59-4617-a189-2cb07b9b1194", "content-length": "173", "date": "Tue, 19 Nov 2024 05:53:28 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"176942d8-6f67-414d-8390-55e992dfe909\"", request_id: "3f734785-1a59-4617-a189-2cb07b9b1194" } file = sled-agent/src/rack_setup/service.rs:1075
16002024-11-19T05:53:31.287ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
16012024-11-19T05:53:31.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43127
16022024-11-19T05:53:31.376ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16032024-11-19T05:53:31.376ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16042024-11-19T05:53:31.377ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/omicron-zones.json file = common/src/ledger.rs:177
16052024-11-19T05:53:31.378ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/omicron-zones.json file = common/src/ledger.rs:177
16062024-11-19T05:53:31.391ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16072024-11-19T05:53:31.391ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8f726703-f78a-4246-88d2-b12195677e7c
16082024-11-19T05:53:31.419ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16092024-11-19T05:53:31.419ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15
16102024-11-19T05:53:31.443ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16112024-11-19T05:53:31.443ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_35a1f44b-de46-41ee-ad1e-96313ecc15b9
16122024-11-19T05:53:31.465ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16132024-11-19T05:53:31.465ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c5fdd794-3bc8-49cb-89e3-b36cc4eb9892
16142024-11-19T05:53:31.491ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16152024-11-19T05:53:31.491ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b94b817f-675d-49a5-b1c9-b8c4fb8b401d
16162024-11-19T05:53:31.517ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16172024-11-19T05:53:31.517ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5c871af8-68dd-4136-bfd3-234cd1e72e1e
16182024-11-19T05:53:31.538ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2d68dcb6-83b9-430c-b8d8-fa955e9efd1b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16192024-11-19T05:53:31.538ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2d68dcb6-83b9-430c-b8d8-fa955e9efd1b
16202024-11-19T05:53:31.558ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16212024-11-19T05:53:31.558ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9
16222024-11-19T05:53:31.578ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16232024-11-19T05:53:31.578ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_685f3f58-b5f9-4e42-8994-bdac247f87cd
16242024-11-19T05:53:31.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217384 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43127 req_id = 115cff38-1846-4cbe-8738-bba2ff2d2421 response_code = 200 uri = /inventory
16252024-11-19T05:53:34.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55348
16262024-11-19T05:53:34.574ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 256f247e-4de6-49b2-a232-cf77d0f780e4, kind: Service { id: bb4d79db-b332-4dd4-8e52-fcecf48e448d }, name: Name("external-dns-bb4d79db-b332-4dd4-8e52-fcecf48e448d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 218])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d1b85f63-706d-4ace-ba0e-597770a5fb36, kind: Service { id: c29d6cd6-2a42-4173-b7b2-1125c4e42dc9 }, name: Name("external-dns-c29d6cd6-2a42-4173-b7b2-1125c4e42dc9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 99])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 06879b4d-7caa-4269-9225-8fc437aa415d, kind: Service { id: 67225c0a-0a53-4e08-a753-a917553c7b98 }, name: Name("nexus-67225c0a-0a53-4e08-a753-a917553c7b98"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 16dfcd1a-39ad-4d73-ad80-575882a493b7, kind: Service { id: 3ad742bb-4404-4a65-bfcd-5935cc6c6458 }, name: Name("nexus-3ad742bb-4404-4a65-bfcd-5935cc6c6458"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff00a53c-dab4-46e5-9026-b7386ebdd8fd, kind: Service { id: 8318957c-506a-4355-8689-147ab934628e }, name: Name("nexus-8318957c-506a-4355-8689-147ab934628e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16272024-11-19T05:53:34.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16282024-11-19T05:53:34.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16292024-11-19T05:53:34.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16302024-11-19T05:53:34.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16312024-11-19T05:53:34.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
16322024-11-19T05:53:34.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16332024-11-19T05:53:34.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55348 req_id = 51cd3c1d-5e40-403b-9efc-0e7fde7978a6 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16342024-11-19T05:53:34.576ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1085
16352024-11-19T05:53:34.887ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58190
16362024-11-19T05:53:34.887ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16372024-11-19T05:53:34.887ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16382024-11-19T05:53:34.887ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/omicron-zones.json file = common/src/ledger.rs:177
16392024-11-19T05:53:34.887ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/omicron-zones.json file = common/src/ledger.rs:177
16402024-11-19T05:53:34.900ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16412024-11-19T05:53:34.900ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8f726703-f78a-4246-88d2-b12195677e7c
16422024-11-19T05:53:34.926ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16432024-11-19T05:53:34.926ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15
16442024-11-19T05:53:34.955ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16452024-11-19T05:53:34.955ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_35a1f44b-de46-41ee-ad1e-96313ecc15b9
16462024-11-19T05:53:34.981ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16472024-11-19T05:53:34.981ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c5fdd794-3bc8-49cb-89e3-b36cc4eb9892
16482024-11-19T05:53:35.006ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16492024-11-19T05:53:35.006ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b94b817f-675d-49a5-b1c9-b8c4fb8b401d
16502024-11-19T05:53:35.032ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16512024-11-19T05:53:35.032ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5c871af8-68dd-4136-bfd3-234cd1e72e1e
16522024-11-19T05:53:35.057ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2d68dcb6-83b9-430c-b8d8-fa955e9efd1b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16532024-11-19T05:53:35.057ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2d68dcb6-83b9-430c-b8d8-fa955e9efd1b
16542024-11-19T05:53:35.081ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16552024-11-19T05:53:35.081ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9
16562024-11-19T05:53:35.108ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16572024-11-19T05:53:35.108ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_685f3f58-b5f9-4e42-8994-bdac247f87cd
16582024-11-19T05:53:35.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236521 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58190 req_id = 10e0f109-77cc-4969-883d-c11fc20446d0 response_code = 200 uri = /inventory
16592024-11-19T05:53:35.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42294
16602024-11-19T05:53:35.440ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 256f247e-4de6-49b2-a232-cf77d0f780e4, kind: Service { id: bb4d79db-b332-4dd4-8e52-fcecf48e448d }, name: Name("external-dns-bb4d79db-b332-4dd4-8e52-fcecf48e448d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 218])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d1b85f63-706d-4ace-ba0e-597770a5fb36, kind: Service { id: c29d6cd6-2a42-4173-b7b2-1125c4e42dc9 }, name: Name("external-dns-c29d6cd6-2a42-4173-b7b2-1125c4e42dc9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 99])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 06879b4d-7caa-4269-9225-8fc437aa415d, kind: Service { id: 67225c0a-0a53-4e08-a753-a917553c7b98 }, name: Name("nexus-67225c0a-0a53-4e08-a753-a917553c7b98"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 16dfcd1a-39ad-4d73-ad80-575882a493b7, kind: Service { id: 3ad742bb-4404-4a65-bfcd-5935cc6c6458 }, name: Name("nexus-3ad742bb-4404-4a65-bfcd-5935cc6c6458"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff00a53c-dab4-46e5-9026-b7386ebdd8fd, kind: Service { id: 8318957c-506a-4355-8689-147ab934628e }, name: Name("nexus-8318957c-506a-4355-8689-147ab934628e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16612024-11-19T05:53:35.440ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16622024-11-19T05:53:35.440ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16632024-11-19T05:53:35.440ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16642024-11-19T05:53:35.440ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16652024-11-19T05:53:35.440ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
16662024-11-19T05:53:35.440ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16672024-11-19T05:53:35.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 442 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42294 req_id = 76354f8d-4dc4-43cb-83a0-7f0d1205bf31 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16682024-11-19T05:53:36.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64408
16692024-11-19T05:53:36.006ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 256f247e-4de6-49b2-a232-cf77d0f780e4, kind: Service { id: bb4d79db-b332-4dd4-8e52-fcecf48e448d }, name: Name("external-dns-bb4d79db-b332-4dd4-8e52-fcecf48e448d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 218])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d1b85f63-706d-4ace-ba0e-597770a5fb36, kind: Service { id: c29d6cd6-2a42-4173-b7b2-1125c4e42dc9 }, name: Name("external-dns-c29d6cd6-2a42-4173-b7b2-1125c4e42dc9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 99])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 06879b4d-7caa-4269-9225-8fc437aa415d, kind: Service { id: 67225c0a-0a53-4e08-a753-a917553c7b98 }, name: Name("nexus-67225c0a-0a53-4e08-a753-a917553c7b98"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 16dfcd1a-39ad-4d73-ad80-575882a493b7, kind: Service { id: 3ad742bb-4404-4a65-bfcd-5935cc6c6458 }, name: Name("nexus-3ad742bb-4404-4a65-bfcd-5935cc6c6458"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff00a53c-dab4-46e5-9026-b7386ebdd8fd, kind: Service { id: 8318957c-506a-4355-8689-147ab934628e }, name: Name("nexus-8318957c-506a-4355-8689-147ab934628e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16702024-11-19T05:53:36.006ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16712024-11-19T05:53:36.006ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16722024-11-19T05:53:36.007ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16732024-11-19T05:53:36.007ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16742024-11-19T05:53:36.007ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
16752024-11-19T05:53:36.007ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16762024-11-19T05:53:36.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 331 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64408 req_id = 73d1a64d-569d-4a15-b2c1-b60368416213 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16772024-11-19T05:53:36.299ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65349
16782024-11-19T05:53:36.299ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 256f247e-4de6-49b2-a232-cf77d0f780e4, kind: Service { id: bb4d79db-b332-4dd4-8e52-fcecf48e448d }, name: Name("external-dns-bb4d79db-b332-4dd4-8e52-fcecf48e448d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 218])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d1b85f63-706d-4ace-ba0e-597770a5fb36, kind: Service { id: c29d6cd6-2a42-4173-b7b2-1125c4e42dc9 }, name: Name("external-dns-c29d6cd6-2a42-4173-b7b2-1125c4e42dc9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 99])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 06879b4d-7caa-4269-9225-8fc437aa415d, kind: Service { id: 67225c0a-0a53-4e08-a753-a917553c7b98 }, name: Name("nexus-67225c0a-0a53-4e08-a753-a917553c7b98"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 16dfcd1a-39ad-4d73-ad80-575882a493b7, kind: Service { id: 3ad742bb-4404-4a65-bfcd-5935cc6c6458 }, name: Name("nexus-3ad742bb-4404-4a65-bfcd-5935cc6c6458"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff00a53c-dab4-46e5-9026-b7386ebdd8fd, kind: Service { id: 8318957c-506a-4355-8689-147ab934628e }, name: Name("nexus-8318957c-506a-4355-8689-147ab934628e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16792024-11-19T05:53:36.299ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16802024-11-19T05:53:36.299ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16812024-11-19T05:53:36.299ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16822024-11-19T05:53:36.299ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16832024-11-19T05:53:36.299ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
16842024-11-19T05:53:36.299ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16852024-11-19T05:53:36.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65349 req_id = 9d24d4a8-ec95-44b9-8182-82f2732b6e26 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16862024-11-19T05:53:37.604ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46949
16872024-11-19T05:53:37.605ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46949 req_id = 9758a602-53a2-4cb7-a971-0b32ec22a082 response_code = 200 uri = /baseboard
16882024-11-19T05:53:41.820ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39733
16892024-11-19T05:53:41.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1720 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39733 req_id = 8ea638d9-c3d0-458a-af30-da2d1eb84f2b response_code = 200 uri = /vpc-routes
16902024-11-19T05:53:41.844ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
16912024-11-19T05:53:41.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1060 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39733 req_id = 78e80f38-5004-4efb-bfda-d8a6e0caf30e response_code = 204 uri = /eip-gateways
16922024-11-19T05:53:41.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39733 req_id = 99772a10-d6eb-4fd4-b91b-032465c20546 response_code = 204 uri = /vpc-routes
16932024-11-19T05:53:44.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45485
16942024-11-19T05:53:44.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45485 req_id = 1ea8e5e8-8c30-4828-8be1-ae87ce5548fa response_code = 200 uri = /vpc-routes
16952024-11-19T05:53:45.022ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
16962024-11-19T05:53:45.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45485 req_id = 7ce79548-3577-4460-a508-b6929d75fd4c response_code = 204 uri = /eip-gateways
16972024-11-19T05:53:45.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45485 req_id = ac38535a-2e41-41f7-b514-9e0e2583f392 response_code = 204 uri = /vpc-routes
16982024-11-19T05:53:45.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46476
16992024-11-19T05:53:45.152ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17002024-11-19T05:53:45.239ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17012024-11-19T05:53:45.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187062 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46476 req_id = 3370ec6b-01ce-403c-bc9b-6ea2d0960e81 response_code = 204 uri = /switch-ports
17022024-11-19T05:53:45.338ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57440
17032024-11-19T05:53:45.338ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54352
17042024-11-19T05:53:45.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57440 req_id = b711f23a-3cf5-4e91-a01a-6e357f6e09da response_code = 200 uri = /vpc-routes
17052024-11-19T05:53:45.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 326 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54352 req_id = a4d02653-f514-4b2c-acfe-1be2c1d91a1b response_code = 200 uri = /v2p
17062024-11-19T05:53:45.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1803 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46476 req_id = 8d2b6be0-db0b-40ce-a88c-d3e6c58c6075 response_code = 200 uri = /network-bootstore-config
17072024-11-19T05:53:45.389ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
17082024-11-19T05:53:45.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57440 req_id = bbedb261-8fab-408a-aa4b-959819c6b3f0 response_code = 204 uri = /eip-gateways
17092024-11-19T05:53:45.399ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
17102024-11-19T05:53:45.399ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17112024-11-19T05:53:45.400ZINFOSledAgent (bootstore): Writing ledger to /pool/int/309add57-857d-42cd-8f12-8351d275a791/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17122024-11-19T05:53:45.401ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
17132024-11-19T05:53:45.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2940 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46476 req_id = 2709c820-f89c-4247-81d0-6978054cb981 response_code = 204 uri = /network-bootstore-config
17142024-11-19T05:53:45.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38982
17152024-11-19T05:53:45.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38982 req_id = 12947053-9606-4313-88a1-0ed7d4f45171 response_code = 200 uri = /v2p
17162024-11-19T05:53:45.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57440 req_id = 95d67a64-e957-4176-9a93-f9c999b02476 response_code = 204 uri = /vpc-routes
17172024-11-19T05:53:45.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38485
17182024-11-19T05:53:45.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38485 req_id = 7267f435-7266-47c5-9956-6d59993e7127 response_code = 200 uri = /vpc-routes
17192024-11-19T05:53:45.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65342
17202024-11-19T05:53:45.521ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17212024-11-19T05:53:45.553ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17222024-11-19T05:53:45.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79168 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65342 req_id = 4b4816c8-a5e3-4df6-a191-0bd848256719 response_code = 204 uri = /switch-ports
17232024-11-19T05:53:45.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53363
17242024-11-19T05:53:45.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53363 req_id = fe4fb571-6da6-4276-b810-c242ff4d9153 response_code = 200 uri = /v2p
17252024-11-19T05:53:45.601ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
17262024-11-19T05:53:45.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65342 req_id = f8954ace-d43d-4141-b322-4aa9c5735399 response_code = 200 uri = /network-bootstore-config
17272024-11-19T05:53:45.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38485 req_id = ac022d1f-8b0e-428d-8e4e-8dc33785d4d2 response_code = 204 uri = /eip-gateways
17282024-11-19T05:53:45.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38485 req_id = 4ed71725-00d9-44e2-b0b7-fa2326da4bec response_code = 204 uri = /vpc-routes
17292024-11-19T05:53:45.640ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65032
17302024-11-19T05:53:45.640ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17312024-11-19T05:53:45.677ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17322024-11-19T05:53:45.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89236 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65032 req_id = 8f6ac71d-42e2-48ba-b0e5-89da56536803 response_code = 204 uri = /switch-ports
17332024-11-19T05:53:45.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65032 req_id = 51064b08-70b0-4e59-8aa4-6c14c9009a01 response_code = 200 uri = /network-bootstore-config
17342024-11-19T05:54:07.637ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39680
17352024-11-19T05:54:07.637ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39680 req_id = 02213a3b-599d-4b96-b789-4a4e40fc53fb response_code = 200 uri = /baseboard
17362024-11-19T05:54:15.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46242
17372024-11-19T05:54:15.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46242 req_id = 6e6fb77f-3520-49bd-a16b-d37ec2a9a4c4 response_code = 200 uri = /vpc-routes
17382024-11-19T05:54:15.183ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
17392024-11-19T05:54:15.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46242 req_id = af6467de-b3d7-403f-b4a6-97ff6050c75b response_code = 204 uri = /eip-gateways
17402024-11-19T05:54:15.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46885
17412024-11-19T05:54:15.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46885 req_id = 4eb70560-583f-4761-9aa1-91f12a61f282 response_code = 200 uri = /v2p
17422024-11-19T05:54:15.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40854
17432024-11-19T05:54:15.296ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17442024-11-19T05:54:15.345ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17452024-11-19T05:54:15.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121151 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40854 req_id = c4307fcb-d85e-4841-84f3-6e1ee3e3ae86 response_code = 204 uri = /switch-ports
17462024-11-19T05:54:15.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46242 req_id = 361e5486-e791-4be9-81aa-a15dc4533a5b response_code = 204 uri = /vpc-routes
17472024-11-19T05:54:15.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40854 req_id = 781ff0f5-ccb5-4898-9952-1d0603c322d7 response_code = 200 uri = /network-bootstore-config
17482024-11-19T05:54:15.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51244
17492024-11-19T05:54:15.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51244 req_id = 5751b26b-d3be-4f90-96e9-3da1d760e674 response_code = 200 uri = /vpc-routes
17502024-11-19T05:54:15.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54629
17512024-11-19T05:54:15.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54629 req_id = f129114c-dfca-4165-b83c-586ac8d18ccb response_code = 200 uri = /v2p
17522024-11-19T05:54:15.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52753
17532024-11-19T05:54:15.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52753 req_id = a43cf64a-6bea-4ddd-9615-3c17903003b8 response_code = 200 uri = /vpc-routes
17542024-11-19T05:54:15.650ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
17552024-11-19T05:54:15.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51244 req_id = 4910b48c-13a4-4964-bdaf-90a894b98897 response_code = 204 uri = /eip-gateways
17562024-11-19T05:54:15.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36212
17572024-11-19T05:54:15.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36212 req_id = 819a2c8f-0f2e-4798-aa9b-42692093b70c response_code = 200 uri = /v2p
17582024-11-19T05:54:15.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51244 req_id = b791ea02-94fd-4fd7-aaf9-94509475d37c response_code = 204 uri = /vpc-routes
17592024-11-19T05:54:15.716ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
17602024-11-19T05:54:15.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52753 req_id = 9440adf1-593e-4976-8287-f4e20a7d61d8 response_code = 204 uri = /eip-gateways
17612024-11-19T05:54:15.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52753 req_id = f4410c3b-f70d-403c-b73c-4c31dab955fa response_code = 204 uri = /vpc-routes
17622024-11-19T05:54:15.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59903
17632024-11-19T05:54:15.753ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17642024-11-19T05:54:15.789ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17652024-11-19T05:54:15.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88695 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59903 req_id = ca4e7449-730f-46d8-94e1-6d79af4e4e33 response_code = 204 uri = /switch-ports
17662024-11-19T05:54:15.842ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57306
17672024-11-19T05:54:15.843ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17682024-11-19T05:54:15.873ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17692024-11-19T05:54:15.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82246 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57306 req_id = db5efc38-5135-48a3-9fb8-6baa0941a6db response_code = 204 uri = /switch-ports
17702024-11-19T05:54:15.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57306 req_id = 1c5cbe89-f384-4080-ab2b-cf0f152c958c response_code = 200 uri = /network-bootstore-config
17712024-11-19T05:54:15.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59903 req_id = 8f415f45-9526-49fd-9214-8a7aa4cb6250 response_code = 200 uri = /network-bootstore-config
17722024-11-19T05:54:37.669ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37748
17732024-11-19T05:54:37.669ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37748 req_id = 1a8454ed-6633-45a6-b5fd-f0c38913bdf3 response_code = 200 uri = /baseboard
17742024-11-19T05:54:45.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63777
17752024-11-19T05:54:45.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63777 req_id = 0f96b279-6098-499f-959e-d7d1742d232a response_code = 200 uri = /vpc-routes
17762024-11-19T05:54:45.155ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
17772024-11-19T05:54:45.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63777 req_id = a0f2ded8-8648-4df5-9eec-688c545cc98b response_code = 204 uri = /eip-gateways
17782024-11-19T05:54:45.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63777 req_id = 3b570de7-79de-4aa6-b35e-ad9f3fa4fff0 response_code = 204 uri = /vpc-routes
17792024-11-19T05:54:45.207ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52020
17802024-11-19T05:54:45.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52020 req_id = 28559a29-3825-40b9-b148-5c91cb26cb96 response_code = 200 uri = /vpc-routes
17812024-11-19T05:54:45.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47976
17822024-11-19T05:54:45.212ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17832024-11-19T05:54:45.271ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17842024-11-19T05:54:45.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131974 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47976 req_id = 35afee60-5cbb-410b-8ac8-8db17597d9b9 response_code = 204 uri = /switch-ports
17852024-11-19T05:54:45.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50260
17862024-11-19T05:54:45.344ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
17872024-11-19T05:54:45.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52020 req_id = a9e78e4b-a56d-470a-9167-82b1ef6216ae response_code = 204 uri = /eip-gateways
17882024-11-19T05:54:45.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47976 req_id = 5c6c0256-abbd-4a6e-b3c1-8082be11ea55 response_code = 200 uri = /network-bootstore-config
17892024-11-19T05:54:45.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50260 req_id = df1e2a72-f85a-468b-9fcb-00aa733e983b response_code = 200 uri = /v2p
17902024-11-19T05:54:45.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43894
17912024-11-19T05:54:45.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43894 req_id = d4671d0c-4da5-4761-8a2b-37038b8c38fe response_code = 200 uri = /v2p
17922024-11-19T05:54:45.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52020 req_id = cef460cb-d3f5-4c3d-940d-15bacd622bc0 response_code = 204 uri = /vpc-routes
17932024-11-19T05:54:45.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59240
17942024-11-19T05:54:45.401ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17952024-11-19T05:54:45.441ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17962024-11-19T05:54:45.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93626 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59240 req_id = 8244c4c0-d35e-43fd-98c7-1895a59c06ac response_code = 204 uri = /switch-ports
17972024-11-19T05:54:45.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51773
17982024-11-19T05:54:45.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51773 req_id = 4d8b0446-86a7-4649-a2c1-d6ff0c67663d response_code = 200 uri = /vpc-routes
17992024-11-19T05:54:45.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59240 req_id = dc089418-320b-4021-968d-0402bee27923 response_code = 200 uri = /network-bootstore-config
18002024-11-19T05:54:45.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51622
18012024-11-19T05:54:45.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51622 req_id = 09275086-30cd-46c4-9927-6dddce31179b response_code = 200 uri = /v2p
18022024-11-19T05:54:45.547ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43005
18032024-11-19T05:54:45.547ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18042024-11-19T05:54:45.582ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18052024-11-19T05:54:45.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93415 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43005 req_id = 8e1df3d1-ba20-4a1f-9812-b048ebd30e65 response_code = 204 uri = /switch-ports
18062024-11-19T05:54:45.641ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
18072024-11-19T05:54:45.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51773 req_id = fd206694-4b4c-420d-93eb-dac18a7147fd response_code = 204 uri = /eip-gateways
18082024-11-19T05:54:45.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43005 req_id = 33620254-3b9f-408b-a839-96cf98f47199 response_code = 200 uri = /network-bootstore-config
18092024-11-19T05:54:45.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51773 req_id = 8aec5d37-0303-4578-8ea9-f8d5ee42bda5 response_code = 204 uri = /vpc-routes
18102024-11-19T05:55:07.702ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57622
18112024-11-19T05:55:07.702ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57622 req_id = 2e80a863-9823-40e7-b7af-da25f1329d05 response_code = 200 uri = /baseboard
18122024-11-19T05:55:15.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56235
18132024-11-19T05:55:15.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56235 req_id = d17a85a3-897e-4225-8d8e-41634ff2cc15 response_code = 200 uri = /vpc-routes
18142024-11-19T05:55:15.207ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
18152024-11-19T05:55:15.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56235 req_id = 6babc3c2-55cc-4567-8fec-3541ab327741 response_code = 204 uri = /eip-gateways
18162024-11-19T05:55:15.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56235 req_id = 3a93f6e8-2130-4a6c-b827-45491398b232 response_code = 204 uri = /vpc-routes
18172024-11-19T05:55:15.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49714
18182024-11-19T05:55:15.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49714 req_id = 3b5cfbf5-2b6d-4180-8d1b-a5aa7b21cb64 response_code = 200 uri = /v2p
18192024-11-19T05:55:15.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44651
18202024-11-19T05:55:15.379ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18212024-11-19T05:55:15.423ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18222024-11-19T05:55:15.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99390 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44651 req_id = 7f648fd1-0265-4000-b952-702bf7608dfd response_code = 204 uri = /switch-ports
18232024-11-19T05:55:15.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44651 req_id = 277b35ff-5107-48f1-92bb-2dd0838dfd5a response_code = 200 uri = /network-bootstore-config
18242024-11-19T05:55:15.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41119
18252024-11-19T05:55:15.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41119 req_id = 63f45887-92c4-427a-b52a-2dfbc6670ba0 response_code = 200 uri = /vpc-routes
18262024-11-19T05:55:15.545ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50408
18272024-11-19T05:55:15.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50408 req_id = ae9cb089-de41-45f4-b1bd-3e13ca865560 response_code = 200 uri = /vpc-routes
18282024-11-19T05:55:15.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47155
18292024-11-19T05:55:15.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47155 req_id = f86cc795-7005-454e-9be8-44a0763964cb response_code = 200 uri = /v2p
18302024-11-19T05:55:15.580ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
18312024-11-19T05:55:15.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41119 req_id = 31bc6cb4-af05-45f8-a418-5ee37d607bb0 response_code = 204 uri = /eip-gateways
18322024-11-19T05:55:15.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41119 req_id = 5bab955e-f02f-48b3-bbf9-f0c3e19ed506 response_code = 204 uri = /vpc-routes
18332024-11-19T05:55:15.596ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
18342024-11-19T05:55:15.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50408 req_id = 7ea490e3-fe14-4cef-a4ba-95a377d2430a response_code = 204 uri = /eip-gateways
18352024-11-19T05:55:15.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50408 req_id = 655244ad-dc30-4ac6-81a5-70a2e7faa819 response_code = 204 uri = /vpc-routes
18362024-11-19T05:55:15.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60827
18372024-11-19T05:55:15.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60827 req_id = 57a5a9e8-06e4-44cc-b4e4-bd627dc4defa response_code = 200 uri = /v2p
18382024-11-19T05:55:15.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60069
18392024-11-19T05:55:15.700ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18402024-11-19T05:55:15.737ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18412024-11-19T05:55:15.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87223 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60069 req_id = 1ef62f35-3bfa-4b9d-a236-d217fbd67a78 response_code = 204 uri = /switch-ports
18422024-11-19T05:55:15.788ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52782
18432024-11-19T05:55:15.788ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18442024-11-19T05:55:15.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60069 req_id = 58d04040-2509-4f53-b4e6-a0ed0f7c9b60 response_code = 200 uri = /network-bootstore-config
18452024-11-19T05:55:15.827ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18462024-11-19T05:55:15.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92631 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52782 req_id = b5156b6b-0d6a-454a-a5b6-4b1ebd4b927a response_code = 204 uri = /switch-ports
18472024-11-19T05:55:15.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52782 req_id = 2ead6d3a-807c-4ba3-9253-e48f86e80b5d response_code = 200 uri = /network-bootstore-config
18482024-11-19T05:55:37.738ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41475
18492024-11-19T05:55:37.738ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41475 req_id = fa81a96b-4dfa-40ca-9228-31626cd3f809 response_code = 200 uri = /baseboard
18502024-11-19T05:55:44.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48357
18512024-11-19T05:55:44.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48357 req_id = 386a1e4b-c10e-4557-9583-6c7e1458f545 response_code = 200 uri = /vpc-routes
18522024-11-19T05:55:45.034ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
18532024-11-19T05:55:45.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48357 req_id = 71391bc9-0df9-44a9-8098-3649dd2fcfae response_code = 204 uri = /eip-gateways
18542024-11-19T05:55:45.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58528
18552024-11-19T05:55:45.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58528 req_id = 46a3f076-acf7-4f67-a94a-b68bf73a524b response_code = 200 uri = /vpc-routes
18562024-11-19T05:55:45.167ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
18572024-11-19T05:55:45.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58528 req_id = c0cb2a97-8b92-4f72-9359-a6e42d2bdffe response_code = 204 uri = /eip-gateways
18582024-11-19T05:55:45.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58528 req_id = 7bd1188e-ab4f-4a12-950d-81d2ce8c0fe6 response_code = 204 uri = /vpc-routes
18592024-11-19T05:55:45.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53894
18602024-11-19T05:55:45.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53894 req_id = 777f6b4f-9f4b-472b-9494-92a63062fc70 response_code = 200 uri = /v2p
18612024-11-19T05:55:45.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39321
18622024-11-19T05:55:45.208ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18632024-11-19T05:55:45.256ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18642024-11-19T05:55:45.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126626 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39321 req_id = 07e2bee3-10cb-4772-8503-b7298964a9eb response_code = 204 uri = /switch-ports
18652024-11-19T05:55:45.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48357 req_id = fb71393f-c14e-4504-8d95-3a0ad59e28bf response_code = 204 uri = /vpc-routes
18662024-11-19T05:55:45.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39321 req_id = e54cded1-d5a1-443b-a983-718e09955691 response_code = 200 uri = /network-bootstore-config
18672024-11-19T05:55:45.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41576
18682024-11-19T05:55:45.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41576 req_id = c7e31199-0422-41ee-b1c5-d1356ef87443 response_code = 200 uri = /v2p
18692024-11-19T05:55:45.397ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35584
18702024-11-19T05:55:45.397ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18712024-11-19T05:55:45.434ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18722024-11-19T05:55:45.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87868 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35584 req_id = be3935a6-f497-41fb-a9f7-7246cb789e75 response_code = 204 uri = /switch-ports
18732024-11-19T05:55:45.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33403
18742024-11-19T05:55:45.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33403 req_id = 37b6076e-8431-458b-9bc4-4c69fd10fbf1 response_code = 200 uri = /vpc-routes
18752024-11-19T05:55:45.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35584 req_id = 0ecb4a79-b863-49f9-97ff-f1ed93be39d3 response_code = 200 uri = /network-bootstore-config
18762024-11-19T05:55:45.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40901
18772024-11-19T05:55:45.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40901 req_id = 7edc668e-7f76-442e-b180-0a16011dffd7 response_code = 200 uri = /v2p
18782024-11-19T05:55:45.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38318
18792024-11-19T05:55:45.523ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18802024-11-19T05:55:45.554ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18812024-11-19T05:55:45.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84516 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38318 req_id = a282558e-e9db-42f2-9758-28bc05cd273f response_code = 204 uri = /switch-ports
18822024-11-19T05:55:45.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38318 req_id = c7534611-d5e5-428e-9b4c-a6afc0c606c7 response_code = 200 uri = /network-bootstore-config
18832024-11-19T05:55:45.608ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
18842024-11-19T05:55:45.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33403 req_id = 4271ff69-9885-4d14-be9a-d1e63c23d717 response_code = 204 uri = /eip-gateways
18852024-11-19T05:55:45.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33403 req_id = 333e03e7-b30c-433a-a705-eadbe927eeef response_code = 204 uri = /vpc-routes
18862024-11-19T05:55:57.949ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
18872024-11-19T05:56:07.773ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41502
18882024-11-19T05:56:07.773ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41502 req_id = e1530b7c-35d9-47de-ac60-20d645104431 response_code = 200 uri = /baseboard
18892024-11-19T05:56:15.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56159
18902024-11-19T05:56:15.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56159 req_id = b137ffca-88ce-4e0d-befa-efc36a17f0a2 response_code = 200 uri = /vpc-routes
18912024-11-19T05:56:15.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51917
18922024-11-19T05:56:15.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51917 req_id = 84aaf09f-2878-48d4-9023-178d5871894b response_code = 200 uri = /vpc-routes
18932024-11-19T05:56:15.344ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
18942024-11-19T05:56:15.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56159 req_id = babba463-e351-4096-8e33-79250be177a8 response_code = 204 uri = /eip-gateways
18952024-11-19T05:56:15.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56159 req_id = d341aa25-26e1-4cc3-929d-e7af1353289f response_code = 204 uri = /vpc-routes
18962024-11-19T05:56:15.363ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
18972024-11-19T05:56:15.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51917 req_id = 131ae1c8-1daf-42ea-a774-42f9eca7b941 response_code = 204 uri = /eip-gateways
18982024-11-19T05:56:15.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51917 req_id = 4669ebd9-ef2b-4cb4-9a09-2e0dfc257030 response_code = 204 uri = /vpc-routes
18992024-11-19T05:56:15.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39962
19002024-11-19T05:56:15.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39962 req_id = eef702b2-f203-4737-878a-31ca167ae2ec response_code = 200 uri = /v2p
19012024-11-19T05:56:15.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57414
19022024-11-19T05:56:15.518ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19032024-11-19T05:56:15.557ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19042024-11-19T05:56:15.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97340 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57414 req_id = 8d71b808-907c-474a-9ba8-3ae3730dc223 response_code = 204 uri = /switch-ports
19052024-11-19T05:56:15.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43510
19062024-11-19T05:56:15.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65208
19072024-11-19T05:56:15.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65208 req_id = f733c99a-f49b-4eee-8df2-6b9c4ba93af0 response_code = 200 uri = /vpc-routes
19082024-11-19T05:56:15.616ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19092024-11-19T05:56:15.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57414 req_id = 5959acd4-e986-4dfe-897a-92252352e533 response_code = 200 uri = /network-bootstore-config
19102024-11-19T05:56:15.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37488
19112024-11-19T05:56:15.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37488 req_id = 9b4c2570-f561-4ddb-ba9c-635b44746cef response_code = 200 uri = /v2p
19122024-11-19T05:56:15.652ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19132024-11-19T05:56:15.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40219
19142024-11-19T05:56:15.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40219 req_id = 280a950c-ff5e-4966-b4f4-a37ae1d4047d response_code = 200 uri = /v2p
19152024-11-19T05:56:15.678ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
19162024-11-19T05:56:15.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 615 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65208 req_id = 558707ab-42cd-43d5-8f1b-28a50db86ccd response_code = 204 uri = /eip-gateways
19172024-11-19T05:56:15.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65208 req_id = be68dcad-ebae-44b1-b4ab-aea654ea809d response_code = 204 uri = /vpc-routes
19182024-11-19T05:56:15.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94681 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43510 req_id = 7041d042-aff1-4d19-b54b-c1903704820b response_code = 204 uri = /switch-ports
19192024-11-19T05:56:15.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43510 req_id = 4f334188-79e4-4314-bf9e-5b41d0936037 response_code = 200 uri = /network-bootstore-config
19202024-11-19T05:56:15.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36507
19212024-11-19T05:56:15.808ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19222024-11-19T05:56:15.843ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19232024-11-19T05:56:15.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88670 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36507 req_id = 440debf6-1981-494d-a8cc-0cda21bb5dbf response_code = 204 uri = /switch-ports
19242024-11-19T05:56:15.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36507 req_id = 43ec31fe-574c-4e6b-ba3d-59be22b4abb5 response_code = 200 uri = /network-bootstore-config
19252024-11-19T05:56:37.809ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51705
19262024-11-19T05:56:37.809ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51705 req_id = 2c0a4b41-abc0-419b-8cdd-365698bd2b24 response_code = 200 uri = /baseboard
19272024-11-19T05:56:45.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55763
19282024-11-19T05:56:45.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55763 req_id = eb0b957c-312f-4073-9dfa-d523d3f5115d response_code = 200 uri = /vpc-routes
19292024-11-19T05:56:45.090ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
19302024-11-19T05:56:45.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55763 req_id = a207ddc4-0a4c-49e6-a7a4-7515377577fc response_code = 204 uri = /eip-gateways
19312024-11-19T05:56:45.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55763 req_id = 646f5370-9ecb-48b8-ad48-dd3ded9a2da1 response_code = 204 uri = /vpc-routes
19322024-11-19T05:56:45.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40764
19332024-11-19T05:56:45.133ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19342024-11-19T05:56:45.172ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19352024-11-19T05:56:45.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113208 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40764 req_id = ede2ebbd-0c09-4cbb-85a7-c38ed5d97352 response_code = 204 uri = /switch-ports
19362024-11-19T05:56:45.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33560
19372024-11-19T05:56:45.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39313
19382024-11-19T05:56:45.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40764 req_id = 6294f9ae-bf21-46ba-a305-2331fe76739b response_code = 200 uri = /network-bootstore-config
19392024-11-19T05:56:45.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39313 req_id = 06745f1c-2577-4fc7-b34e-33a0bd5fd536 response_code = 200 uri = /vpc-routes
19402024-11-19T05:56:45.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33560 req_id = 22cdbb40-cd17-4976-9a7d-239094603337 response_code = 200 uri = /v2p
19412024-11-19T05:56:45.312ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
19422024-11-19T05:56:45.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39313 req_id = 5dcc1f98-8681-4265-a2c6-c5ce4f399305 response_code = 204 uri = /eip-gateways
19432024-11-19T05:56:45.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34652
19442024-11-19T05:56:45.324ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19452024-11-19T05:56:45.367ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19462024-11-19T05:56:45.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102909 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34652 req_id = 365b74db-a916-4433-b8ca-0442a54ec4e8 response_code = 204 uri = /switch-ports
19472024-11-19T05:56:45.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39313 req_id = c7c67024-bbfe-4767-a9db-4d1477af8522 response_code = 204 uri = /vpc-routes
19482024-11-19T05:56:45.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34652 req_id = f0114711-4b40-4241-85fe-165420737710 response_code = 200 uri = /network-bootstore-config
19492024-11-19T05:56:45.434ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43134
19502024-11-19T05:56:45.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43134 req_id = 2b2c2d53-7c4a-4707-a667-ee43b0a574c7 response_code = 200 uri = /v2p
19512024-11-19T05:56:45.608ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52929
19522024-11-19T05:56:45.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52929 req_id = 9c3a5a73-2e8c-4240-952d-ce7ec32e4dba response_code = 200 uri = /vpc-routes
19532024-11-19T05:56:45.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44160
19542024-11-19T05:56:45.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44160 req_id = 1513510f-38b9-42ed-8eea-2bc89355dcfa response_code = 200 uri = /v2p
19552024-11-19T05:56:45.623ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
19562024-11-19T05:56:45.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52929 req_id = a698dacf-e6a5-4ff5-8e68-1d1556b422ba response_code = 204 uri = /eip-gateways
19572024-11-19T05:56:45.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52929 req_id = 78760f3d-38b2-411b-876e-d084fb50e672 response_code = 204 uri = /vpc-routes
19582024-11-19T05:56:45.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63656
19592024-11-19T05:56:45.658ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19602024-11-19T05:56:45.696ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19612024-11-19T05:56:45.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87589 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63656 req_id = eab090c6-9645-4d29-8a35-ef23f23da635 response_code = 204 uri = /switch-ports
19622024-11-19T05:56:45.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63656 req_id = 94d28fb4-1704-4956-abd8-c6475251c0fe response_code = 200 uri = /network-bootstore-config
19632024-11-19T05:57:07.842ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48318
19642024-11-19T05:57:07.842ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48318 req_id = 3e231ae1-5c02-48ac-8d45-baafacf6e825 response_code = 200 uri = /baseboard
19652024-11-19T05:57:15.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64460
19662024-11-19T05:57:15.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64460 req_id = 3855c9d3-3496-4aa0-b94a-baddaafdd2a4 response_code = 200 uri = /vpc-routes
19672024-11-19T05:57:15.142ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
19682024-11-19T05:57:15.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 585 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64460 req_id = a982bcbe-85ca-4c65-bd7d-f85c9df6ae9d response_code = 204 uri = /eip-gateways
19692024-11-19T05:57:15.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64460 req_id = b41e94e5-e4f1-4ced-82ff-8d52a27ef2b5 response_code = 204 uri = /vpc-routes
19702024-11-19T05:57:15.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42743
19712024-11-19T05:57:15.293ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19722024-11-19T05:57:15.343ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19732024-11-19T05:57:15.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119828 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42743 req_id = 85a5087a-8aa8-4b7b-add0-5fd5842d3d79 response_code = 204 uri = /switch-ports
19742024-11-19T05:57:15.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40560
19752024-11-19T05:57:15.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55552
19762024-11-19T05:57:15.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55552 req_id = acf753a6-8c0f-46d9-a4bc-23dbfe5ca63d response_code = 200 uri = /vpc-routes
19772024-11-19T05:57:15.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42743 req_id = 9339173b-8e62-479a-a89a-69bb09889084 response_code = 200 uri = /network-bootstore-config
19782024-11-19T05:57:15.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40560 req_id = a70663ad-6573-4664-be94-d81f363fd4ae response_code = 200 uri = /v2p
19792024-11-19T05:57:15.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61178
19802024-11-19T05:57:15.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61178 req_id = 02fb2006-a20e-45b1-93bf-cfc6b41e528b response_code = 200 uri = /vpc-routes
19812024-11-19T05:57:15.457ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
19822024-11-19T05:57:15.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55552 req_id = 3afb7942-0acc-4aee-98ac-de044feed52e response_code = 204 uri = /eip-gateways
19832024-11-19T05:57:15.483ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
19842024-11-19T05:57:15.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61178 req_id = 63cb4fe2-8067-42ae-8dfd-a39a5a078804 response_code = 204 uri = /eip-gateways
19852024-11-19T05:57:15.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37988
19862024-11-19T05:57:15.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37988 req_id = 5fe2dfc0-27e2-426f-a77a-aac20f80a304 response_code = 200 uri = /v2p
19872024-11-19T05:57:15.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55552 req_id = 3f7a968a-768b-4e7c-9c37-775a3e6586de response_code = 204 uri = /vpc-routes
19882024-11-19T05:57:15.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56050
19892024-11-19T05:57:15.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56050 req_id = cf8d4c35-a1f0-4841-b6ab-1beda924be7f response_code = 200 uri = /v2p
19902024-11-19T05:57:15.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61178 req_id = c05de9e7-aa9e-4cca-adfc-0a1f9ae592fe response_code = 204 uri = /vpc-routes
19912024-11-19T05:57:15.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64070
19922024-11-19T05:57:15.577ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19932024-11-19T05:57:15.615ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19942024-11-19T05:57:15.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98451 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64070 req_id = 2343e31d-63b7-4adf-90d8-723a23bf6dd1 response_code = 204 uri = /switch-ports
19952024-11-19T05:57:15.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59487
19962024-11-19T05:57:15.676ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19972024-11-19T05:57:15.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64070 req_id = 291d1b90-9383-4624-894a-fffa3a6c4d75 response_code = 200 uri = /network-bootstore-config
19982024-11-19T05:57:15.711ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19992024-11-19T05:57:15.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85820 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59487 req_id = c4ff15cd-03e9-457d-8537-f452539cac6d response_code = 204 uri = /switch-ports
20002024-11-19T05:57:15.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59487 req_id = 3c88cb15-883d-421e-af54-536744dc1be5 response_code = 200 uri = /network-bootstore-config
20012024-11-19T05:57:37.876ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54174
20022024-11-19T05:57:37.876ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54174 req_id = c383b400-f742-48ff-bc80-e8deaa3cb7fb response_code = 200 uri = /baseboard
20032024-11-19T05:57:45.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60803
20042024-11-19T05:57:45.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60803 req_id = 488c1e07-4242-4f8e-8bb8-afd26bfe189f response_code = 200 uri = /vpc-routes
20052024-11-19T05:57:45.133ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
20062024-11-19T05:57:45.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60803 req_id = 2aecf741-8add-4550-9594-91ccd20a7529 response_code = 204 uri = /eip-gateways
20072024-11-19T05:57:45.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42697
20082024-11-19T05:57:45.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42697 req_id = e7834785-291a-42b6-afdd-fac175315caf response_code = 200 uri = /v2p
20092024-11-19T05:57:45.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60803 req_id = 75a9f28d-df9e-4dda-b7dd-45c0df38ddd9 response_code = 204 uri = /vpc-routes
20102024-11-19T05:57:45.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44354
20112024-11-19T05:57:45.199ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20122024-11-19T05:57:45.245ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20132024-11-19T05:57:45.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117177 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44354 req_id = 03b73cd0-5044-47e8-945c-19516789366f response_code = 204 uri = /switch-ports
20142024-11-19T05:57:45.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44354 req_id = a117c023-bcaa-4f31-9696-f0a9c2e0003c response_code = 200 uri = /network-bootstore-config
20152024-11-19T05:57:45.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43138
20162024-11-19T05:57:45.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43138 req_id = 4fd9f054-dcb4-4662-9b0c-cbbfdeadf38f response_code = 200 uri = /vpc-routes
20172024-11-19T05:57:45.388ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
20182024-11-19T05:57:45.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43138 req_id = 14bb94ef-5ffd-4590-9dcf-d8b3b5a67a02 response_code = 204 uri = /eip-gateways
20192024-11-19T05:57:45.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43138 req_id = 3d928bed-a599-4fb0-9dfd-bf1fff85c7fb response_code = 204 uri = /vpc-routes
20202024-11-19T05:57:45.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50888
20212024-11-19T05:57:45.448ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20222024-11-19T05:57:45.487ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20232024-11-19T05:57:45.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95871 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50888 req_id = fdf77934-e7fe-4a52-b35e-67a5aba6cc5e response_code = 204 uri = /switch-ports
20242024-11-19T05:57:45.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63275
20252024-11-19T05:57:45.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47281
20262024-11-19T05:57:45.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47281 req_id = 07197969-351f-4ca4-9db1-3ad2014345ed response_code = 200 uri = /vpc-routes
20272024-11-19T05:57:45.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50888 req_id = 782d313a-99ca-49d8-8188-7b9560057d13 response_code = 200 uri = /network-bootstore-config
20282024-11-19T05:57:45.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63275 req_id = d4c938eb-3bf6-43e1-9a83-7c43f414c2f9 response_code = 200 uri = /v2p
20292024-11-19T05:57:45.559ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56927
20302024-11-19T05:57:45.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56927 req_id = 8a94da9c-4620-4cbc-83f5-52471fa5a6da response_code = 200 uri = /v2p
20312024-11-19T05:57:45.600ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
20322024-11-19T05:57:45.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47281 req_id = 5904e189-3abc-44a2-95f6-6487eddaeaed response_code = 204 uri = /eip-gateways
20332024-11-19T05:57:45.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47281 req_id = 002574a1-8854-4e0d-9166-a162054f076a response_code = 204 uri = /vpc-routes
20342024-11-19T05:57:45.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44873
20352024-11-19T05:57:45.649ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20362024-11-19T05:57:45.687ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20372024-11-19T05:57:45.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94850 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44873 req_id = b1bb4fac-be18-4f9c-8d6d-51c4c3ce1f6e response_code = 204 uri = /switch-ports
20382024-11-19T05:57:45.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44873 req_id = 6f367278-b44c-406a-b4b9-437bfa3246fc response_code = 200 uri = /network-bootstore-config
20392024-11-19T05:58:07.911ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47202
20402024-11-19T05:58:07.911ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47202 req_id = 6785eb95-e9b4-4670-8d28-e720a0207769 response_code = 200 uri = /baseboard
20412024-11-19T05:58:15.087ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56603
20422024-11-19T05:58:15.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56603 req_id = 0e0a6537-869f-454d-92a0-ed8a8fcae06b response_code = 200 uri = /vpc-routes
20432024-11-19T05:58:15.160ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
20442024-11-19T05:58:15.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56603 req_id = a6857c39-e85e-4eb8-a5d1-5137efa5b0f7 response_code = 204 uri = /eip-gateways
20452024-11-19T05:58:15.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56603 req_id = fa818561-809d-44d8-97b9-08a9dc418471 response_code = 204 uri = /vpc-routes
20462024-11-19T05:58:15.406ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34455
20472024-11-19T05:58:15.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34455 req_id = c118051e-2f2e-4281-8f9d-0868064fcd36 response_code = 200 uri = /v2p
20482024-11-19T05:58:15.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48193
20492024-11-19T05:58:15.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48193 req_id = 135bc78b-b5c9-42ba-85e1-e18040803139 response_code = 200 uri = /vpc-routes
20502024-11-19T05:58:15.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50866
20512024-11-19T05:58:15.468ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20522024-11-19T05:58:15.514ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20532024-11-19T05:58:15.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108225 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50866 req_id = c6d10667-704a-48b5-9fcc-e32f9e7bf07d response_code = 204 uri = /switch-ports
20542024-11-19T05:58:15.576ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58663
20552024-11-19T05:58:15.576ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36551
20562024-11-19T05:58:15.576ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
20572024-11-19T05:58:15.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48193 req_id = 1597ca1f-1b46-4af3-8030-19c7e236e52e response_code = 204 uri = /eip-gateways
20582024-11-19T05:58:15.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50866 req_id = e65d9f27-4a4d-4fc6-a988-94302843fe4a response_code = 200 uri = /network-bootstore-config
20592024-11-19T05:58:15.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58663 req_id = 8e4dc95d-22f2-4094-a1f3-af547de930b3 response_code = 200 uri = /vpc-routes
20602024-11-19T05:58:15.577ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 256f247e-4de6-49b2-a232-cf77d0f780e4, kind: Service { id: bb4d79db-b332-4dd4-8e52-fcecf48e448d }, name: Name("external-dns-bb4d79db-b332-4dd4-8e52-fcecf48e448d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 218])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d1b85f63-706d-4ace-ba0e-597770a5fb36, kind: Service { id: c29d6cd6-2a42-4173-b7b2-1125c4e42dc9 }, name: Name("external-dns-c29d6cd6-2a42-4173-b7b2-1125c4e42dc9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 99])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 06879b4d-7caa-4269-9225-8fc437aa415d, kind: Service { id: 67225c0a-0a53-4e08-a753-a917553c7b98 }, name: Name("nexus-67225c0a-0a53-4e08-a753-a917553c7b98"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 16dfcd1a-39ad-4d73-ad80-575882a493b7, kind: Service { id: 3ad742bb-4404-4a65-bfcd-5935cc6c6458 }, name: Name("nexus-3ad742bb-4404-4a65-bfcd-5935cc6c6458"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff00a53c-dab4-46e5-9026-b7386ebdd8fd, kind: Service { id: 8318957c-506a-4355-8689-147ab934628e }, name: Name("nexus-8318957c-506a-4355-8689-147ab934628e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20612024-11-19T05:58:15.577ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20622024-11-19T05:58:15.577ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20632024-11-19T05:58:15.577ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20642024-11-19T05:58:15.577ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20652024-11-19T05:58:15.577ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
20662024-11-19T05:58:15.577ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20672024-11-19T05:58:15.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 427 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36551 req_id = 0843e9ea-2590-464b-8c46-3a6b008c5877 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20682024-11-19T05:58:15.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48193 req_id = 98beab0f-4cbc-44d6-8468-4b5f898eb9e1 response_code = 204 uri = /vpc-routes
20692024-11-19T05:58:15.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58283
20702024-11-19T05:58:15.603ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20712024-11-19T05:58:15.653ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20722024-11-19T05:58:15.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118829 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58283 req_id = 95b3fbd2-4e7d-44c3-a1aa-815e27cc777d response_code = 204 uri = /switch-ports
20732024-11-19T05:58:15.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55368
20742024-11-19T05:58:15.722ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
20752024-11-19T05:58:15.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58663 req_id = 1898d1d2-899a-49eb-8989-68c714c02110 response_code = 204 uri = /eip-gateways
20762024-11-19T05:58:15.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46330
20772024-11-19T05:58:15.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58283 req_id = 55223a41-6447-4d2e-959b-5fba4134841a response_code = 200 uri = /network-bootstore-config
20782024-11-19T05:58:15.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55368 req_id = bfe81438-987e-4bd0-ab34-8de30ab2e399 response_code = 200 uri = /v2p
20792024-11-19T05:58:15.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46330 req_id = 74198f10-7ce8-4bca-af87-e5018c3a7f0b response_code = 200 uri = /v2p
20802024-11-19T05:58:15.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41900
20812024-11-19T05:58:15.725ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 256f247e-4de6-49b2-a232-cf77d0f780e4, kind: Service { id: bb4d79db-b332-4dd4-8e52-fcecf48e448d }, name: Name("external-dns-bb4d79db-b332-4dd4-8e52-fcecf48e448d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 218])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d1b85f63-706d-4ace-ba0e-597770a5fb36, kind: Service { id: c29d6cd6-2a42-4173-b7b2-1125c4e42dc9 }, name: Name("external-dns-c29d6cd6-2a42-4173-b7b2-1125c4e42dc9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 99])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 06879b4d-7caa-4269-9225-8fc437aa415d, kind: Service { id: 67225c0a-0a53-4e08-a753-a917553c7b98 }, name: Name("nexus-67225c0a-0a53-4e08-a753-a917553c7b98"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 16dfcd1a-39ad-4d73-ad80-575882a493b7, kind: Service { id: 3ad742bb-4404-4a65-bfcd-5935cc6c6458 }, name: Name("nexus-3ad742bb-4404-4a65-bfcd-5935cc6c6458"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff00a53c-dab4-46e5-9026-b7386ebdd8fd, kind: Service { id: 8318957c-506a-4355-8689-147ab934628e }, name: Name("nexus-8318957c-506a-4355-8689-147ab934628e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20822024-11-19T05:58:15.725ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20832024-11-19T05:58:15.725ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20842024-11-19T05:58:15.726ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20852024-11-19T05:58:15.726ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20862024-11-19T05:58:15.726ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
20872024-11-19T05:58:15.726ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20882024-11-19T05:58:15.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41900 req_id = c2865fe6-6545-454e-93d3-31cb65bd7a53 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20892024-11-19T05:58:15.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58663 req_id = cc645531-7cab-4579-9e42-883037ebe403 response_code = 204 uri = /vpc-routes
20902024-11-19T05:58:15.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55739
20912024-11-19T05:58:15.794ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20922024-11-19T05:58:15.831ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20932024-11-19T05:58:15.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95436 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55739 req_id = cdfbb862-7ef0-46e0-82b4-db47f86f44a2 response_code = 204 uri = /switch-ports
20942024-11-19T05:58:15.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32926
20952024-11-19T05:58:15.890ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 256f247e-4de6-49b2-a232-cf77d0f780e4, kind: Service { id: bb4d79db-b332-4dd4-8e52-fcecf48e448d }, name: Name("external-dns-bb4d79db-b332-4dd4-8e52-fcecf48e448d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 218])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d1b85f63-706d-4ace-ba0e-597770a5fb36, kind: Service { id: c29d6cd6-2a42-4173-b7b2-1125c4e42dc9 }, name: Name("external-dns-c29d6cd6-2a42-4173-b7b2-1125c4e42dc9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 99])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 06879b4d-7caa-4269-9225-8fc437aa415d, kind: Service { id: 67225c0a-0a53-4e08-a753-a917553c7b98 }, name: Name("nexus-67225c0a-0a53-4e08-a753-a917553c7b98"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 16dfcd1a-39ad-4d73-ad80-575882a493b7, kind: Service { id: 3ad742bb-4404-4a65-bfcd-5935cc6c6458 }, name: Name("nexus-3ad742bb-4404-4a65-bfcd-5935cc6c6458"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff00a53c-dab4-46e5-9026-b7386ebdd8fd, kind: Service { id: 8318957c-506a-4355-8689-147ab934628e }, name: Name("nexus-8318957c-506a-4355-8689-147ab934628e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20962024-11-19T05:58:15.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20972024-11-19T05:58:15.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55739 req_id = 6b4167ce-a409-4d13-8dfb-8d3b08d5ff07 response_code = 200 uri = /network-bootstore-config
20982024-11-19T05:58:15.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20992024-11-19T05:58:15.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21002024-11-19T05:58:15.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21012024-11-19T05:58:15.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
21022024-11-19T05:58:15.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21032024-11-19T05:58:15.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 363 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32926 req_id = 4b1ffda4-2773-4208-b17f-1eba178e24c8 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21042024-11-19T05:58:37.943ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44927
21052024-11-19T05:58:37.943ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44927 req_id = a502f2fa-8c42-4be8-936b-19575dc47f7c response_code = 200 uri = /baseboard
21062024-11-19T05:58:45.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64797
21072024-11-19T05:58:45.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64797 req_id = a90ede9b-53c0-4675-9363-9ad20b0a05e6 response_code = 200 uri = /vpc-routes
21082024-11-19T05:58:45.048ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
21092024-11-19T05:58:45.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64797 req_id = f2dc8e77-0663-432d-82ed-69cbf23d9f54 response_code = 204 uri = /eip-gateways
21102024-11-19T05:58:45.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64797 req_id = 0e0295df-05e1-441d-beb1-0fb2bae3ce7b response_code = 204 uri = /vpc-routes
21112024-11-19T05:58:45.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42317
21122024-11-19T05:58:45.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42317 req_id = bbae70c0-de06-4234-a5ea-1aa4540f5150 response_code = 200 uri = /v2p
21132024-11-19T05:58:45.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49369
21142024-11-19T05:58:45.144ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21152024-11-19T05:58:45.182ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21162024-11-19T05:58:45.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105037 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49369 req_id = d76e193b-3f22-4e7a-994f-18f27f3ab225 response_code = 204 uri = /switch-ports
21172024-11-19T05:58:45.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56979
21182024-11-19T05:58:45.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56979 req_id = 6bf69eed-f496-495d-a10d-b7ff963c329e response_code = 200 uri = /vpc-routes
21192024-11-19T05:58:45.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49369 req_id = 5b3ee030-1ab4-4eff-8d4a-1230d8d4556b response_code = 200 uri = /network-bootstore-config
21202024-11-19T05:58:45.310ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
21212024-11-19T05:58:45.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56979 req_id = 79b454a8-1656-4c28-ad4f-4a3fa49df8fb response_code = 204 uri = /eip-gateways
21222024-11-19T05:58:45.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 333 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56979 req_id = bf02277c-2d4e-4745-b80f-46e91e392a65 response_code = 204 uri = /vpc-routes
21232024-11-19T05:58:45.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45956
21242024-11-19T05:58:45.335ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21252024-11-19T05:58:45.375ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21262024-11-19T05:58:45.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97352 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45956 req_id = b029e013-7715-45ab-a5b3-7ee67620eb33 response_code = 204 uri = /switch-ports
21272024-11-19T05:58:45.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45956 req_id = 63b6e56c-68ef-4632-890b-24ad4b082deb response_code = 200 uri = /network-bootstore-config
21282024-11-19T05:58:45.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53193
21292024-11-19T05:58:45.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53193 req_id = 710f5041-3949-43eb-ad72-62b3c3f4f77b response_code = 200 uri = /v2p
21302024-11-19T05:58:45.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64799
21312024-11-19T05:58:45.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64799 req_id = 78dc5217-6962-4560-9489-85d2640751b0 response_code = 200 uri = /vpc-routes
21322024-11-19T05:58:45.532ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
21332024-11-19T05:58:45.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64799 req_id = b77dfca4-1d9d-401c-adc6-ab9a4faa6866 response_code = 204 uri = /eip-gateways
21342024-11-19T05:58:45.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37251
21352024-11-19T05:58:45.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37251 req_id = 07291882-6108-4980-9535-31d38d90dddb response_code = 200 uri = /v2p
21362024-11-19T05:58:45.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64799 req_id = f4e5a460-9b9a-46b8-8bd5-8f4bf34de3e2 response_code = 204 uri = /vpc-routes
21372024-11-19T05:58:45.691ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35844
21382024-11-19T05:58:45.692ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21392024-11-19T05:58:45.727ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21402024-11-19T05:58:45.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92479 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35844 req_id = f84bd01e-b747-41bc-ade9-afbdb2123eff response_code = 204 uri = /switch-ports
21412024-11-19T05:58:45.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35844 req_id = 6c9842ed-3583-47a6-8b84-2e36d4ac4902 response_code = 200 uri = /network-bootstore-config
21422024-11-19T05:59:07.979ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38082
21432024-11-19T05:59:07.979ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38082 req_id = c23ba6be-bcff-47e1-95f4-6be2649b5c94 response_code = 200 uri = /baseboard
21442024-11-19T05:59:15.107ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61960
21452024-11-19T05:59:15.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61960 req_id = 16e87f2b-7131-45b6-bff3-12c9ca6c2956 response_code = 200 uri = /vpc-routes
21462024-11-19T05:59:15.139ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
21472024-11-19T05:59:15.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61960 req_id = be802db0-ead7-4e39-945b-e491a42b10a7 response_code = 204 uri = /eip-gateways
21482024-11-19T05:59:15.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61960 req_id = 755f2687-5b36-4d4b-8ca4-23e17a63013e response_code = 204 uri = /vpc-routes
21492024-11-19T05:59:15.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37354
21502024-11-19T05:59:15.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37354 req_id = 73979e16-77c7-47d1-9c4b-6aeb7835d8fc response_code = 200 uri = /v2p
21512024-11-19T05:59:15.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57398
21522024-11-19T05:59:15.328ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21532024-11-19T05:59:15.372ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21542024-11-19T05:59:15.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105530 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57398 req_id = de5c9f8c-403e-46bd-b465-578ec07b5c88 response_code = 204 uri = /switch-ports
21552024-11-19T05:59:15.434ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56915
21562024-11-19T05:59:15.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56915 req_id = 875622f9-91ba-422c-b70c-66086a312953 response_code = 200 uri = /vpc-routes
21572024-11-19T05:59:15.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57398 req_id = e5f212a3-fbcb-4a25-845f-cc4fdc1f78ad response_code = 200 uri = /network-bootstore-config
21582024-11-19T05:59:15.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60815
21592024-11-19T05:59:15.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60815 req_id = 5506677c-719a-408e-93d9-55619d3eafe5 response_code = 200 uri = /vpc-routes
21602024-11-19T05:59:15.493ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
21612024-11-19T05:59:15.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56915 req_id = a3000b56-4b75-4ce9-9c16-1b71e2406a04 response_code = 204 uri = /eip-gateways
21622024-11-19T05:59:15.529ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
21632024-11-19T05:59:15.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60815 req_id = 0a277a86-9602-4f2c-a793-48ebec741019 response_code = 204 uri = /eip-gateways
21642024-11-19T05:59:15.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60815 req_id = 6bed5643-f9f5-4aa3-8d30-d8a1d4e78ad1 response_code = 204 uri = /vpc-routes
21652024-11-19T05:59:15.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38361
21662024-11-19T05:59:15.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38361 req_id = be2fdd84-b35f-4b95-b7e0-0ea6164b3bc1 response_code = 200 uri = /v2p
21672024-11-19T05:59:15.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56915 req_id = 32d5fba4-25fd-4541-a2b1-a9fe340a4ae4 response_code = 204 uri = /vpc-routes
21682024-11-19T05:59:15.640ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35021
21692024-11-19T05:59:15.640ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21702024-11-19T05:59:15.682ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21712024-11-19T05:59:15.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100087 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35021 req_id = 5f22203c-23d2-4e52-8469-bb19c5d4cafe response_code = 204 uri = /switch-ports
21722024-11-19T05:59:15.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57972
21732024-11-19T05:59:15.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54626
21742024-11-19T05:59:15.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54626 req_id = cb91f2a3-be93-4d49-bb9e-31b9e7cbfc21 response_code = 200 uri = /v2p
21752024-11-19T05:59:15.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35021 req_id = 98b95947-4e49-45b2-8d3f-4d3293db3710 response_code = 200 uri = /network-bootstore-config
21762024-11-19T05:59:15.741ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21772024-11-19T05:59:15.774ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21782024-11-19T05:59:15.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84296 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57972 req_id = a344963b-33eb-45f6-8aa6-b1bb153e56f0 response_code = 204 uri = /switch-ports
21792024-11-19T05:59:15.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57972 req_id = 04b1f59c-e2c6-48eb-8438-bacc67d76cfc response_code = 200 uri = /network-bootstore-config
21802024-11-19T05:59:38.012ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53294
21812024-11-19T05:59:38.012ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53294 req_id = c0e59de1-8d86-427e-ade2-956c73836f11 response_code = 200 uri = /baseboard
21822024-11-19T05:59:44.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33835
21832024-11-19T05:59:44.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33835 req_id = 4461a93f-f2bc-480a-bd3b-a97f9ce4b322 response_code = 200 uri = /vpc-routes
21842024-11-19T05:59:44.966ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
21852024-11-19T05:59:44.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33835 req_id = 6f53025c-b466-4225-9eac-7c7765e53acb response_code = 204 uri = /eip-gateways
21862024-11-19T05:59:44.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33835 req_id = 8b990c90-dfd0-4a06-bead-cbbda219fcd9 response_code = 204 uri = /vpc-routes
21872024-11-19T05:59:45.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39219
21882024-11-19T05:59:45.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39219 req_id = 4a94e28c-d5ea-475a-aa17-a0ac9598e275 response_code = 200 uri = /v2p
21892024-11-19T05:59:45.063ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44723
21902024-11-19T05:59:45.063ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21912024-11-19T05:59:45.109ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21922024-11-19T05:59:45.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115487 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44723 req_id = 0abef735-62a8-486c-a175-55f7ed1c7a33 response_code = 204 uri = /switch-ports
21932024-11-19T05:59:45.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61276
21942024-11-19T05:59:45.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61276 req_id = 5973f37d-da36-4deb-8c9c-68b7a188f194 response_code = 200 uri = /vpc-routes
21952024-11-19T05:59:45.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44723 req_id = e37282a3-3dd9-47b5-b78a-9d582ff584b5 response_code = 200 uri = /network-bootstore-config
21962024-11-19T05:59:45.233ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
21972024-11-19T05:59:45.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61276 req_id = 2546c880-d9bc-4201-bb83-aa705820377a response_code = 204 uri = /eip-gateways
21982024-11-19T05:59:45.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61276 req_id = 5a5b740e-b509-4b8c-ab41-2f77c0d1c2b9 response_code = 204 uri = /vpc-routes
21992024-11-19T05:59:45.317ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59083
22002024-11-19T05:59:45.317ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22012024-11-19T05:59:45.370ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22022024-11-19T05:59:45.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125672 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59083 req_id = 3dded0dd-ff24-4ca2-a16e-03f2e6487d5c response_code = 204 uri = /switch-ports
22032024-11-19T05:59:45.443ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44739
22042024-11-19T05:59:45.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44739 req_id = 2d4f4482-127a-4474-831c-72eaf3ff4f74 response_code = 200 uri = /v2p
22052024-11-19T05:59:45.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59083 req_id = 495aecfa-6e44-4904-91c7-d662b8ec7e66 response_code = 200 uri = /network-bootstore-config
22062024-11-19T05:59:45.457ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42258
22072024-11-19T05:59:45.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42258 req_id = 63e53120-0f25-4297-b4ce-e8520c91ddea response_code = 200 uri = /vpc-routes
22082024-11-19T05:59:45.498ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
22092024-11-19T05:59:45.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42258 req_id = 3601d176-8a18-4c83-9010-b5055aae617d response_code = 204 uri = /eip-gateways
22102024-11-19T05:59:45.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42258 req_id = c89eaee7-4fd1-415b-870e-6336f8400ea3 response_code = 204 uri = /vpc-routes
22112024-11-19T05:59:45.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52490
22122024-11-19T05:59:45.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52490 req_id = 10dc5948-aa75-437a-bdff-9247f9b6d4a3 response_code = 200 uri = /v2p
22132024-11-19T05:59:45.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62325
22142024-11-19T05:59:45.575ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22152024-11-19T05:59:45.612ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22162024-11-19T05:59:45.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92118 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62325 req_id = def8b404-d976-4c1e-b64d-cc5de4f38b13 response_code = 204 uri = /switch-ports
22172024-11-19T05:59:45.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62325 req_id = 56fc4585-ca65-4eaf-9cf1-9480fa5250be response_code = 200 uri = /network-bootstore-config
22182024-11-19T06:00:08.046ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36286
22192024-11-19T06:00:08.046ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36286 req_id = d5279947-6ca7-4fd8-9e79-65654e6b2f80 response_code = 200 uri = /baseboard
22202024-11-19T06:00:15.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55489
22212024-11-19T06:00:15.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55489 req_id = e0ebdf07-7fa2-4936-a42a-67e03a946f26 response_code = 200 uri = /vpc-routes
22222024-11-19T06:00:15.321ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
22232024-11-19T06:00:15.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55489 req_id = c2af65cf-e03b-4fef-b529-5bf70e938397 response_code = 204 uri = /eip-gateways
22242024-11-19T06:00:15.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55489 req_id = 27ee7fb9-42e6-4ab6-9d82-29db3ff54445 response_code = 204 uri = /vpc-routes
22252024-11-19T06:00:15.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60990
22262024-11-19T06:00:15.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60990 req_id = 31aa0205-bd09-4fc4-8486-03f50f63b86b response_code = 200 uri = /vpc-routes
22272024-11-19T06:00:15.414ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
22282024-11-19T06:00:15.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60990 req_id = ebeaf5e4-7e59-40ab-a6ab-2e0b7c30bdf4 response_code = 204 uri = /eip-gateways
22292024-11-19T06:00:15.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60990 req_id = b45f268b-ea1b-4894-bdcb-fdac6c20cb7f response_code = 204 uri = /vpc-routes
22302024-11-19T06:00:15.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37513
22312024-11-19T06:00:15.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37513 req_id = 4e49e374-b784-4259-be10-91f478a96d6c response_code = 200 uri = /v2p
22322024-11-19T06:00:15.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53463
22332024-11-19T06:00:15.521ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22342024-11-19T06:00:15.569ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22352024-11-19T06:00:15.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105562 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53463 req_id = 485c39ea-19ee-47d8-ba16-5d097f88d6be response_code = 204 uri = /switch-ports
22362024-11-19T06:00:15.626ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45939
22372024-11-19T06:00:15.626ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46627
22382024-11-19T06:00:15.627ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65075
22392024-11-19T06:00:15.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65075 req_id = 0ecae635-3866-4dff-87e2-cb7cb959b2b4 response_code = 200 uri = /vpc-routes
22402024-11-19T06:00:15.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53463 req_id = 6f4c09f8-dbd3-4dd5-97d8-c3a05134a532 response_code = 200 uri = /network-bootstore-config
22412024-11-19T06:00:15.627ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22422024-11-19T06:00:15.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7650 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46627 req_id = 792cd44e-92fe-4908-ad3b-33f5dfd72ec2 response_code = 200 uri = /v2p
22432024-11-19T06:00:15.669ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
22442024-11-19T06:00:15.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65075 req_id = a69aa158-2dee-442a-81e4-a37e1a493af1 response_code = 204 uri = /eip-gateways
22452024-11-19T06:00:15.673ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22462024-11-19T06:00:15.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65075 req_id = 3a724457-16a1-4c33-88f4-c562770ff764 response_code = 204 uri = /vpc-routes
22472024-11-19T06:00:15.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111274 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45939 req_id = b0e78cc7-316e-46d3-8ba0-cb1ef43b085c response_code = 204 uri = /switch-ports
22482024-11-19T06:00:15.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45939 req_id = 1e8d524e-0779-47d6-95dc-fe513d74707c response_code = 200 uri = /network-bootstore-config
22492024-11-19T06:00:15.771ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38352
22502024-11-19T06:00:15.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38352 req_id = 54c99786-bcb6-4d59-b7db-69bfaad2ef21 response_code = 200 uri = /v2p
22512024-11-19T06:00:15.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37993
22522024-11-19T06:00:15.829ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22532024-11-19T06:00:15.869ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22542024-11-19T06:00:15.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95854 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37993 req_id = 4614d6e7-18a7-45f5-9fcd-2c5ffa01a8b3 response_code = 204 uri = /switch-ports
22552024-11-19T06:00:15.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37993 req_id = 0409d1ee-93be-4c0f-9558-1b3a211f21ec response_code = 200 uri = /network-bootstore-config
22562024-11-19T06:00:23.450ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22572024-11-19T06:00:23.451ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22582024-11-19T06:00:23.452ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22592024-11-19T06:00:23.519ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22602024-11-19T06:00:23.521ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22612024-11-19T06:00:23.521ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22622024-11-19T06:00:23.523ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22632024-11-19T06:00:23.524ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22642024-11-19T06:00:23.525ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22652024-11-19T06:00:33.452ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22662024-11-19T06:00:33.453ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22672024-11-19T06:00:33.453ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22682024-11-19T06:00:33.454ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22692024-11-19T06:00:33.455ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22702024-11-19T06:00:33.455ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22712024-11-19T06:00:33.456ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22722024-11-19T06:00:33.456ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22732024-11-19T06:00:33.516ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22742024-11-19T06:00:33.519ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22752024-11-19T06:00:33.521ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22762024-11-19T06:00:33.522ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22772024-11-19T06:00:33.522ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22782024-11-19T06:00:33.524ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22792024-11-19T06:00:33.524ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22802024-11-19T06:00:33.525ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22812024-11-19T06:00:33.527ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22822024-11-19T06:00:33.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22832024-11-19T06:00:38.079ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45887
22842024-11-19T06:00:38.079ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45887 req_id = 8730f04c-25e3-4cf6-9fdf-4c3efab57a10 response_code = 200 uri = /baseboard
22852024-11-19T06:00:43.456ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22862024-11-19T06:00:43.457ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22872024-11-19T06:00:43.458ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22882024-11-19T06:00:43.458ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22892024-11-19T06:00:43.459ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22902024-11-19T06:00:43.459ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22912024-11-19T06:00:43.460ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22922024-11-19T06:00:43.461ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22932024-11-19T06:00:43.519ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22942024-11-19T06:00:43.521ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22952024-11-19T06:00:43.523ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22962024-11-19T06:00:43.523ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22972024-11-19T06:00:43.524ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22982024-11-19T06:00:43.525ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
22992024-11-19T06:00:43.526ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23002024-11-19T06:00:43.527ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23012024-11-19T06:00:43.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23022024-11-19T06:00:43.529ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23032024-11-19T06:00:43.649ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23042024-11-19T06:00:43.649ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
23052024-11-19T06:00:43.680ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 3874, tv_nsec: 468112288 } time_to_next_cleanup = 599.99999523s
23062024-11-19T06:00:45.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36042
23072024-11-19T06:00:45.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36042 req_id = b9a13979-823e-4eb1-94f9-dbe24577010a response_code = 200 uri = /vpc-routes
23082024-11-19T06:00:45.058ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
23092024-11-19T06:00:45.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36042 req_id = 48ca75c8-ba0f-4535-a289-3198240b75ce response_code = 204 uri = /eip-gateways
23102024-11-19T06:00:45.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36042 req_id = 570dcaf4-06bd-4265-aee2-af5f36cd1af4 response_code = 204 uri = /vpc-routes
23112024-11-19T06:00:45.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47657
23122024-11-19T06:00:45.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47657 req_id = 310ce7ff-be51-4df9-a705-0f583001825f response_code = 200 uri = /v2p
23132024-11-19T06:00:45.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47939
23142024-11-19T06:00:45.184ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23152024-11-19T06:00:45.225ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23162024-11-19T06:00:45.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132468 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47939 req_id = def1a094-d112-4cdb-acc6-c8ce6bcb2784 response_code = 204 uri = /switch-ports
23172024-11-19T06:00:45.317ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55582
23182024-11-19T06:00:45.317ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44175
23192024-11-19T06:00:45.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55582 req_id = c53a5fa2-2596-4a1f-a84d-7b9b1ef25762 response_code = 200 uri = /vpc-routes
23202024-11-19T06:00:45.317ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23212024-11-19T06:00:45.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47939 req_id = 9b70919b-2ce9-449e-a31a-96aba9714211 response_code = 200 uri = /network-bootstore-config
23222024-11-19T06:00:45.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47403
23232024-11-19T06:00:45.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47403 req_id = 8eca88d2-5b05-4026-be28-881914f19af4 response_code = 200 uri = /v2p
23242024-11-19T06:00:45.361ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
23252024-11-19T06:00:45.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55582 req_id = 00155038-9e2b-4840-a526-dc37cf678eec response_code = 204 uri = /eip-gateways
23262024-11-19T06:00:45.363ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23272024-11-19T06:00:45.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55582 req_id = c6e6d913-995e-49f8-a078-b90f1dd95140 response_code = 204 uri = /vpc-routes
23282024-11-19T06:00:45.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103954 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44175 req_id = 0d53d3d1-6157-4d84-96a6-753c62f9718e response_code = 204 uri = /switch-ports
23292024-11-19T06:00:45.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44175 req_id = d2ab5e26-dfd3-4133-aee1-8df60e8d1913 response_code = 200 uri = /network-bootstore-config
23302024-11-19T06:00:45.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61637
23312024-11-19T06:00:45.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61637 req_id = 712b880c-675b-4f85-a8b5-fe887ec6a0f5 response_code = 200 uri = /vpc-routes
23322024-11-19T06:00:45.499ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
23332024-11-19T06:00:45.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61637 req_id = a7c080f5-4622-4a3f-9057-a8c63f527680 response_code = 204 uri = /eip-gateways
23342024-11-19T06:00:45.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61637 req_id = 7c8c7122-49a0-400a-86ec-f5f523af38e6 response_code = 204 uri = /vpc-routes
23352024-11-19T06:00:45.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53536
23362024-11-19T06:00:45.532ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23372024-11-19T06:00:45.578ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23382024-11-19T06:00:45.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100131 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53536 req_id = 108f6cdd-f337-4a3b-9a1c-b796b9738140 response_code = 204 uri = /switch-ports
23392024-11-19T06:00:45.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48864
23402024-11-19T06:00:45.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48864 req_id = 5ff7eee8-3a94-4d72-8c52-b8b4472767ee response_code = 200 uri = /v2p
23412024-11-19T06:00:45.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53536 req_id = 16fa95fc-6e59-448b-acf5-e6197e6108b7 response_code = 200 uri = /network-bootstore-config
23422024-11-19T06:00:53.460ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23432024-11-19T06:00:53.461ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23442024-11-19T06:00:53.462ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23452024-11-19T06:00:53.462ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23462024-11-19T06:00:53.463ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23472024-11-19T06:00:53.463ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23482024-11-19T06:00:53.464ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23492024-11-19T06:00:53.465ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23502024-11-19T06:00:53.521ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23512024-11-19T06:00:53.523ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23522024-11-19T06:00:53.525ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23532024-11-19T06:00:53.526ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23542024-11-19T06:00:53.526ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23552024-11-19T06:00:53.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23562024-11-19T06:00:53.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23572024-11-19T06:00:53.529ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23582024-11-19T06:00:53.530ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23592024-11-19T06:00:53.531ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23602024-11-19T06:00:57.958ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23612024-11-19T06:01:03.465ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23622024-11-19T06:01:03.465ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23632024-11-19T06:01:03.466ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23642024-11-19T06:01:03.467ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23652024-11-19T06:01:03.468ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23662024-11-19T06:01:03.468ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23672024-11-19T06:01:03.469ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23682024-11-19T06:01:03.469ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23692024-11-19T06:01:03.523ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23702024-11-19T06:01:03.525ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23712024-11-19T06:01:03.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23722024-11-19T06:01:03.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23732024-11-19T06:01:03.529ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23742024-11-19T06:01:03.530ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23752024-11-19T06:01:03.531ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23762024-11-19T06:01:03.532ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23772024-11-19T06:01:03.533ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23782024-11-19T06:01:03.533ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23792024-11-19T06:01:08.113ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47095
23802024-11-19T06:01:08.113ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47095 req_id = 00b28f6c-2996-452d-a4f6-2360c2f794ee response_code = 200 uri = /baseboard
23812024-11-19T06:01:13.468ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23822024-11-19T06:01:13.469ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23832024-11-19T06:01:13.470ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23842024-11-19T06:01:13.471ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23852024-11-19T06:01:13.472ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23862024-11-19T06:01:13.472ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23872024-11-19T06:01:13.473ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23882024-11-19T06:01:13.473ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23892024-11-19T06:01:13.525ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23902024-11-19T06:01:13.526ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23912024-11-19T06:01:13.529ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23922024-11-19T06:01:13.531ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23932024-11-19T06:01:13.531ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23942024-11-19T06:01:13.532ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23952024-11-19T06:01:13.533ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23962024-11-19T06:01:13.534ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23972024-11-19T06:01:13.535ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23982024-11-19T06:01:13.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
23992024-11-19T06:01:15.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48468
24002024-11-19T06:01:15.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48468 req_id = 60484811-db31-4c4e-94f5-40fd8c989632 response_code = 200 uri = /vpc-routes
24012024-11-19T06:01:15.210ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
24022024-11-19T06:01:15.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48468 req_id = 49f902be-87d8-48ed-a34e-a9fd074435f1 response_code = 204 uri = /eip-gateways
24032024-11-19T06:01:15.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48468 req_id = 49edf40a-81b5-4002-bc19-5c14d94e59b2 response_code = 204 uri = /vpc-routes
24042024-11-19T06:01:15.318ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33156
24052024-11-19T06:01:15.318ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24062024-11-19T06:01:15.364ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24072024-11-19T06:01:15.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119280 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33156 req_id = 202d78b2-66d1-4301-941d-1052939c077d response_code = 204 uri = /switch-ports
24082024-11-19T06:01:15.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60808
24092024-11-19T06:01:15.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50353
24102024-11-19T06:01:15.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50353 req_id = 40229bd3-27dd-4109-9a53-52753922a583 response_code = 200 uri = /vpc-routes
24112024-11-19T06:01:15.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33156 req_id = c2b54d98-5aa1-4c0a-9a58-76f6d3c15133 response_code = 200 uri = /network-bootstore-config
24122024-11-19T06:01:15.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60808 req_id = 7b734857-74b7-46df-affe-22402d6ded7d response_code = 200 uri = /v2p
24132024-11-19T06:01:15.487ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
24142024-11-19T06:01:15.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50353 req_id = 10fc541e-9396-4f2e-8a80-656c4bef9e9a response_code = 204 uri = /eip-gateways
24152024-11-19T06:01:15.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50353 req_id = f7bd66da-41e0-484d-afec-1468c998577a response_code = 204 uri = /vpc-routes
24162024-11-19T06:01:15.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36415
24172024-11-19T06:01:15.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36415 req_id = 407215e3-9bdb-4c5f-bacb-d88e8f8147ed response_code = 200 uri = /vpc-routes
24182024-11-19T06:01:15.563ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
24192024-11-19T06:01:15.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36415 req_id = 6df8433e-79b6-4e8e-a166-4fc4c651bcce response_code = 204 uri = /eip-gateways
24202024-11-19T06:01:15.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36415 req_id = f4a14cbf-150f-49ed-a245-05c07d89851e response_code = 204 uri = /vpc-routes
24212024-11-19T06:01:15.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40761
24222024-11-19T06:01:15.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40761 req_id = fd1e115d-3c3c-4b00-864d-c2f7cc234f75 response_code = 200 uri = /v2p
24232024-11-19T06:01:15.639ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33446
24242024-11-19T06:01:15.640ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24252024-11-19T06:01:15.680ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24262024-11-19T06:01:15.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99631 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33446 req_id = 0650cc47-16ce-40bf-8d54-b428a48503e4 response_code = 204 uri = /switch-ports
24272024-11-19T06:01:15.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35432
24282024-11-19T06:01:15.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42222
24292024-11-19T06:01:15.740ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24302024-11-19T06:01:15.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4002 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35432 req_id = 4e372c53-2517-47a7-9723-eaf2659c4578 response_code = 200 uri = /v2p
24312024-11-19T06:01:15.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33446 req_id = f46dd1ee-cf6c-4330-ac4d-1efd9038c055 response_code = 200 uri = /network-bootstore-config
24322024-11-19T06:01:15.773ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24332024-11-19T06:01:15.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91133 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42222 req_id = 9541903e-2787-48ed-81da-c8e22027dc81 response_code = 204 uri = /switch-ports
24342024-11-19T06:01:15.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42222 req_id = 5c29615f-0325-433b-b2d1-626b676781d2 response_code = 200 uri = /network-bootstore-config
24352024-11-19T06:01:23.472ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24362024-11-19T06:01:23.473ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24372024-11-19T06:01:23.474ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24382024-11-19T06:01:23.475ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24392024-11-19T06:01:23.475ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24402024-11-19T06:01:23.476ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24412024-11-19T06:01:23.476ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24422024-11-19T06:01:23.477ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24432024-11-19T06:01:23.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24442024-11-19T06:01:23.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24452024-11-19T06:01:23.530ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24462024-11-19T06:01:23.533ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24472024-11-19T06:01:23.534ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24482024-11-19T06:01:23.535ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24492024-11-19T06:01:23.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24502024-11-19T06:01:23.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24512024-11-19T06:01:23.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24522024-11-19T06:01:23.538ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24532024-11-19T06:01:33.478ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24542024-11-19T06:01:33.479ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24552024-11-19T06:01:33.479ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24562024-11-19T06:01:33.480ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24572024-11-19T06:01:33.481ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24582024-11-19T06:01:33.481ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24592024-11-19T06:01:33.482ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24602024-11-19T06:01:33.482ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24612024-11-19T06:01:33.530ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24622024-11-19T06:01:33.531ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24632024-11-19T06:01:33.531ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24642024-11-19T06:01:33.534ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24652024-11-19T06:01:33.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24662024-11-19T06:01:33.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24672024-11-19T06:01:33.538ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24682024-11-19T06:01:33.539ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24692024-11-19T06:01:33.539ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24702024-11-19T06:01:33.540ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24712024-11-19T06:01:38.145ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46727
24722024-11-19T06:01:38.162ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46727 req_id = 1bcf97a4-8d1e-43bb-ba59-cfd27d62a544 response_code = 200 uri = /baseboard
24732024-11-19T06:01:43.483ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24742024-11-19T06:01:43.484ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24752024-11-19T06:01:43.484ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24762024-11-19T06:01:43.485ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24772024-11-19T06:01:43.486ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24782024-11-19T06:01:43.486ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24792024-11-19T06:01:43.487ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24802024-11-19T06:01:43.487ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24812024-11-19T06:01:43.532ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24822024-11-19T06:01:43.532ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24832024-11-19T06:01:43.534ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24842024-11-19T06:01:43.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24852024-11-19T06:01:43.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24862024-11-19T06:01:43.539ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24872024-11-19T06:01:43.540ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24882024-11-19T06:01:43.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24892024-11-19T06:01:43.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24902024-11-19T06:01:43.542ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
24912024-11-19T06:01:45.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49306
24922024-11-19T06:01:45.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49306 req_id = 3fb94f7b-3c11-4be3-ae36-98a1e647ecca response_code = 200 uri = /vpc-routes
24932024-11-19T06:01:45.025ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
24942024-11-19T06:01:45.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49306 req_id = 988bf92a-a631-4ac8-907b-f5a68a43648f response_code = 204 uri = /eip-gateways
24952024-11-19T06:01:45.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49306 req_id = 05b47806-ae5d-47cd-82f3-1d322bfae721 response_code = 204 uri = /vpc-routes
24962024-11-19T06:01:45.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33276
24972024-11-19T06:01:45.109ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24982024-11-19T06:01:45.150ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24992024-11-19T06:01:45.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103766 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33276 req_id = 9e08fd18-30d2-411d-9035-542c359be3d2 response_code = 204 uri = /switch-ports
25002024-11-19T06:01:45.213ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46941
25012024-11-19T06:01:45.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33276 req_id = 7d7ea7be-7523-45cd-90da-39f6fa683dce response_code = 200 uri = /network-bootstore-config
25022024-11-19T06:01:45.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46941 req_id = 34308ca1-472e-4540-a2f0-64a86c937b80 response_code = 200 uri = /v2p
25032024-11-19T06:01:45.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63111
25042024-11-19T06:01:45.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63111 req_id = 1d1abee6-ca41-419b-b762-794b22742ba5 response_code = 200 uri = /vpc-routes
25052024-11-19T06:01:45.338ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43169
25062024-11-19T06:01:45.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43169 req_id = 7c7831c2-fa76-44b1-9199-1c274010f204 response_code = 200 uri = /v2p
25072024-11-19T06:01:45.353ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
25082024-11-19T06:01:45.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63111 req_id = 05a996b1-65d7-4088-ae0c-47b8ed6e745b response_code = 204 uri = /eip-gateways
25092024-11-19T06:01:45.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63111 req_id = 65e4010f-69fc-419b-9e84-30d535f5012d response_code = 204 uri = /vpc-routes
25102024-11-19T06:01:45.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64648
25112024-11-19T06:01:45.404ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25122024-11-19T06:01:45.445ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25132024-11-19T06:01:45.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104408 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64648 req_id = 89e1999c-2f87-45ea-97a4-6500b1d942b7 response_code = 204 uri = /switch-ports
25142024-11-19T06:01:45.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62102
25152024-11-19T06:01:45.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64648 req_id = 60a71f52-1469-4ef3-8465-687b32348fee response_code = 200 uri = /network-bootstore-config
25162024-11-19T06:01:45.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62102 req_id = 81f17e2c-d623-4522-a44d-8f63dbf1111b response_code = 200 uri = /vpc-routes
25172024-11-19T06:01:45.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36333
25182024-11-19T06:01:45.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36333 req_id = e8f85a30-896a-4a48-950e-8e8205452562 response_code = 200 uri = /v2p
25192024-11-19T06:01:45.548ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
25202024-11-19T06:01:45.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62102 req_id = 80ca35ca-8336-4c3a-9dc2-2e9571ca329f response_code = 204 uri = /eip-gateways
25212024-11-19T06:01:45.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62102 req_id = 43f88541-cff7-4c90-8542-da52f96e1482 response_code = 204 uri = /vpc-routes
25222024-11-19T06:01:45.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41397
25232024-11-19T06:01:45.583ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25242024-11-19T06:01:45.629ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25252024-11-19T06:01:45.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103814 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41397 req_id = 8c964b1f-54d7-4424-8781-705967720954 response_code = 204 uri = /switch-ports
25262024-11-19T06:01:45.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41397 req_id = e89c050f-ed23-4815-91be-fdfffa6a46df response_code = 200 uri = /network-bootstore-config
25272024-11-19T06:01:53.488ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25282024-11-19T06:01:53.489ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25292024-11-19T06:01:53.489ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25302024-11-19T06:01:53.490ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25312024-11-19T06:01:53.491ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25322024-11-19T06:01:53.491ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25332024-11-19T06:01:53.492ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25342024-11-19T06:01:53.492ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25352024-11-19T06:01:53.534ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25362024-11-19T06:01:53.535ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25372024-11-19T06:01:53.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25382024-11-19T06:01:53.538ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25392024-11-19T06:01:53.539ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25402024-11-19T06:01:53.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25412024-11-19T06:01:53.542ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25422024-11-19T06:01:53.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25432024-11-19T06:01:53.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25442024-11-19T06:01:53.544ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25452024-11-19T06:02:03.492ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25462024-11-19T06:02:03.493ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25472024-11-19T06:02:03.494ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25482024-11-19T06:02:03.495ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25492024-11-19T06:02:03.495ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25502024-11-19T06:02:03.496ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25512024-11-19T06:02:03.496ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25522024-11-19T06:02:03.497ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25532024-11-19T06:02:03.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25542024-11-19T06:02:03.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25552024-11-19T06:02:03.538ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25562024-11-19T06:02:03.540ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25572024-11-19T06:02:03.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25582024-11-19T06:02:03.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25592024-11-19T06:02:03.544ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25602024-11-19T06:02:03.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25612024-11-19T06:02:03.546ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25622024-11-19T06:02:03.546ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25632024-11-19T06:02:08.194ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53933
25642024-11-19T06:02:08.194ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53933 req_id = fd015a6d-e107-479a-8a72-8e697216cb56 response_code = 200 uri = /baseboard
25652024-11-19T06:02:13.497ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25662024-11-19T06:02:13.498ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25672024-11-19T06:02:13.499ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25682024-11-19T06:02:13.499ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25692024-11-19T06:02:13.500ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25702024-11-19T06:02:13.501ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25712024-11-19T06:02:13.501ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25722024-11-19T06:02:13.502ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25732024-11-19T06:02:13.538ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25742024-11-19T06:02:13.538ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25752024-11-19T06:02:13.540ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25762024-11-19T06:02:13.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25772024-11-19T06:02:13.542ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25782024-11-19T06:02:13.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25792024-11-19T06:02:13.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25802024-11-19T06:02:13.548ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25812024-11-19T06:02:13.548ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25822024-11-19T06:02:13.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
25832024-11-19T06:02:15.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36611
25842024-11-19T06:02:15.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36611 req_id = a535115f-603d-4a27-9c67-bfb9c1656da3 response_code = 200 uri = /vpc-routes
25852024-11-19T06:02:15.186ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
25862024-11-19T06:02:15.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36611 req_id = 16d9a604-0798-411e-8307-556b3fbda093 response_code = 204 uri = /eip-gateways
25872024-11-19T06:02:15.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36611 req_id = 349144c9-6053-4af6-aa43-d29e0200f559 response_code = 204 uri = /vpc-routes
25882024-11-19T06:02:15.254ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40883
25892024-11-19T06:02:15.254ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25902024-11-19T06:02:15.316ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25912024-11-19T06:02:15.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145164 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40883 req_id = ef60c45c-c0b9-4916-ba40-aefdd5db808f response_code = 204 uri = /switch-ports
25922024-11-19T06:02:15.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56401
25932024-11-19T06:02:15.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40883 req_id = 0093cad6-5667-4c53-be6d-f6756530a490 response_code = 200 uri = /network-bootstore-config
25942024-11-19T06:02:15.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56401 req_id = e7eb9682-f9bb-4104-a37c-6d1ecb95f6ca response_code = 200 uri = /v2p
25952024-11-19T06:02:15.425ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57113
25962024-11-19T06:02:15.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57113 req_id = b8592b7f-8f9e-4587-95b5-91477baa18af response_code = 200 uri = /vpc-routes
25972024-11-19T06:02:15.485ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
25982024-11-19T06:02:15.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57113 req_id = 99293d71-79bc-4ead-91c0-b3083ca01524 response_code = 204 uri = /eip-gateways
25992024-11-19T06:02:15.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57113 req_id = 1514f073-0509-444c-a176-47fe71c58dee response_code = 204 uri = /vpc-routes
26002024-11-19T06:02:15.515ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37953
26012024-11-19T06:02:15.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37953 req_id = 2349b3ce-6435-4392-a24a-d64be1a3f978 response_code = 200 uri = /vpc-routes
26022024-11-19T06:02:15.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34580
26032024-11-19T06:02:15.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34580 req_id = 9c981c0a-82c7-40bc-b149-e55706193444 response_code = 200 uri = /v2p
26042024-11-19T06:02:15.575ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
26052024-11-19T06:02:15.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37953 req_id = cee95334-4e51-4e18-8853-3e19a67bd90d response_code = 204 uri = /eip-gateways
26062024-11-19T06:02:15.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58384
26072024-11-19T06:02:15.585ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26082024-11-19T06:02:15.630ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26092024-11-19T06:02:15.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103678 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58384 req_id = 0bacf168-1465-469b-8e49-ec11f87167d9 response_code = 204 uri = /switch-ports
26102024-11-19T06:02:15.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37953 req_id = d6340586-c9e9-49a0-98b0-3c037fec231d response_code = 204 uri = /vpc-routes
26112024-11-19T06:02:15.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58384 req_id = efcfc92e-a402-4ea9-b26e-30fadddd128d response_code = 200 uri = /network-bootstore-config
26122024-11-19T06:02:15.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34822
26132024-11-19T06:02:15.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34822 req_id = 6140342a-c71f-4470-9eea-a34a3bb03282 response_code = 200 uri = /v2p
26142024-11-19T06:02:15.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35439
26152024-11-19T06:02:15.790ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26162024-11-19T06:02:15.832ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26172024-11-19T06:02:15.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106280 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35439 req_id = b392fe05-de1b-476b-a46b-2f7d2cccea3b response_code = 204 uri = /switch-ports
26182024-11-19T06:02:15.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35439 req_id = 638bf24b-2168-4c71-8b65-2a67549ebf87 response_code = 200 uri = /network-bootstore-config
26192024-11-19T06:02:23.501ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26202024-11-19T06:02:23.502ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26212024-11-19T06:02:23.502ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26222024-11-19T06:02:23.503ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26232024-11-19T06:02:23.504ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26242024-11-19T06:02:23.504ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26252024-11-19T06:02:23.505ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26262024-11-19T06:02:23.505ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26272024-11-19T06:02:23.540ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26282024-11-19T06:02:23.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26292024-11-19T06:02:23.542ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26302024-11-19T06:02:23.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26312024-11-19T06:02:23.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26322024-11-19T06:02:23.547ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26332024-11-19T06:02:23.548ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26342024-11-19T06:02:23.550ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26352024-11-19T06:02:23.550ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26362024-11-19T06:02:23.551ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26372024-11-19T06:02:33.505ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26382024-11-19T06:02:33.506ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26392024-11-19T06:02:33.507ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26402024-11-19T06:02:33.507ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26412024-11-19T06:02:33.508ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26422024-11-19T06:02:33.509ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26432024-11-19T06:02:33.509ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26442024-11-19T06:02:33.510ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26452024-11-19T06:02:33.542ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26462024-11-19T06:02:33.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26472024-11-19T06:02:33.544ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26482024-11-19T06:02:33.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26492024-11-19T06:02:33.546ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26502024-11-19T06:02:33.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26512024-11-19T06:02:33.550ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26522024-11-19T06:02:33.552ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26532024-11-19T06:02:33.552ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26542024-11-19T06:02:33.553ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26552024-11-19T06:02:38.226ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42120
26562024-11-19T06:02:38.226ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42120 req_id = 82b9b51e-17d0-43a0-92a2-863f96d78081 response_code = 200 uri = /baseboard
26572024-11-19T06:02:43.509ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26582024-11-19T06:02:43.510ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26592024-11-19T06:02:43.511ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26602024-11-19T06:02:43.511ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26612024-11-19T06:02:43.512ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26622024-11-19T06:02:43.512ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26632024-11-19T06:02:43.513ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26642024-11-19T06:02:43.514ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26652024-11-19T06:02:43.544ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26662024-11-19T06:02:43.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26672024-11-19T06:02:43.546ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26682024-11-19T06:02:43.547ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26692024-11-19T06:02:43.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26702024-11-19T06:02:43.551ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26712024-11-19T06:02:43.552ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26722024-11-19T06:02:43.554ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26732024-11-19T06:02:43.554ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26742024-11-19T06:02:43.555ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
26752024-11-19T06:02:44.974ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34691
26762024-11-19T06:02:44.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34691 req_id = 62ebf2f9-7c3f-40ec-ba34-667a146507f8 response_code = 200 uri = /vpc-routes
26772024-11-19T06:02:45.018ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
26782024-11-19T06:02:45.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34691 req_id = d0e5fd91-3e26-42bf-85c3-2c0925d385eb response_code = 204 uri = /eip-gateways
26792024-11-19T06:02:45.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34691 req_id = cb090c27-b181-4f8b-a09a-5bacf41dcdc0 response_code = 204 uri = /vpc-routes
26802024-11-19T06:02:45.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37836
26812024-11-19T06:02:45.066ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26822024-11-19T06:02:45.117ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26832024-11-19T06:02:45.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118795 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37836 req_id = fc305f2e-45f2-4f72-b85e-a034ce28e2e6 response_code = 204 uri = /switch-ports
26842024-11-19T06:02:45.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35756
26852024-11-19T06:02:45.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35756 req_id = 82dfba34-e175-4546-8a5d-f1e812070da7 response_code = 200 uri = /v2p
26862024-11-19T06:02:45.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37836 req_id = e85c2f1e-ad31-41d7-9200-98cbf5faa080 response_code = 200 uri = /network-bootstore-config
26872024-11-19T06:02:45.273ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37536
26882024-11-19T06:02:45.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37536 req_id = 2a7d5bb4-3d62-4012-aad6-8a44a0a133b1 response_code = 200 uri = /vpc-routes
26892024-11-19T06:02:45.331ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
26902024-11-19T06:02:45.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37536 req_id = ce8d26cd-97b2-46b3-bcb9-85a3a6022519 response_code = 204 uri = /eip-gateways
26912024-11-19T06:02:45.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37536 req_id = 08332e18-1708-4a9b-bfa2-ad7791dbd243 response_code = 204 uri = /vpc-routes
26922024-11-19T06:02:45.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52233
26932024-11-19T06:02:45.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52233 req_id = b529a8da-a631-4361-869c-c8854f1d71a0 response_code = 200 uri = /v2p
26942024-11-19T06:02:45.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57839
26952024-11-19T06:02:45.378ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26962024-11-19T06:02:45.419ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26972024-11-19T06:02:45.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102005 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57839 req_id = f5133f73-0a6f-4218-955b-76297edb838d response_code = 204 uri = /switch-ports
26982024-11-19T06:02:45.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41032
26992024-11-19T06:02:45.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41032 req_id = d02a847e-b85d-41e2-a2c8-9b79db72669c response_code = 200 uri = /vpc-routes
27002024-11-19T06:02:45.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57839 req_id = 66e307a9-e6b8-48ed-996e-22504a0b81d7 response_code = 200 uri = /network-bootstore-config
27012024-11-19T06:02:45.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53633
27022024-11-19T06:02:45.522ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27032024-11-19T06:02:45.564ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27042024-11-19T06:02:45.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99723 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53633 req_id = cbf9424b-8fa8-4eff-a54f-cdaf01271937 response_code = 204 uri = /switch-ports
27052024-11-19T06:02:45.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39209
27062024-11-19T06:02:45.622ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
27072024-11-19T06:02:45.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41032 req_id = 7c2920e5-0e44-4dfc-a535-b29fa679499a response_code = 204 uri = /eip-gateways
27082024-11-19T06:02:45.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53633 req_id = 6e6088ba-7548-41fa-a459-d7336bb3e505 response_code = 200 uri = /network-bootstore-config
27092024-11-19T06:02:45.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39209 req_id = 4fad64ed-56e2-4079-bca4-ec98cfdbc3b1 response_code = 200 uri = /v2p
27102024-11-19T06:02:45.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41032 req_id = e651c5cd-3e59-4ca6-904b-b0f44a79ddff response_code = 204 uri = /vpc-routes
27112024-11-19T06:02:53.513ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27122024-11-19T06:02:53.514ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27132024-11-19T06:02:53.515ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27142024-11-19T06:02:53.515ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27152024-11-19T06:02:53.516ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27162024-11-19T06:02:53.517ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27172024-11-19T06:02:53.517ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27182024-11-19T06:02:53.518ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27192024-11-19T06:02:53.546ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27202024-11-19T06:02:53.547ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27212024-11-19T06:02:53.548ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27222024-11-19T06:02:53.548ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27232024-11-19T06:02:53.551ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27242024-11-19T06:02:53.552ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27252024-11-19T06:02:53.553ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27262024-11-19T06:02:53.556ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27272024-11-19T06:02:53.557ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27282024-11-19T06:02:53.558ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27292024-11-19T06:03:03.517ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27302024-11-19T06:03:03.518ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27312024-11-19T06:03:03.518ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27322024-11-19T06:03:03.519ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27332024-11-19T06:03:03.520ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27342024-11-19T06:03:03.520ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27352024-11-19T06:03:03.521ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27362024-11-19T06:03:03.521ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27372024-11-19T06:03:03.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27382024-11-19T06:03:03.550ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27392024-11-19T06:03:03.550ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27402024-11-19T06:03:03.551ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27412024-11-19T06:03:03.554ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27422024-11-19T06:03:03.555ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27432024-11-19T06:03:03.556ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27442024-11-19T06:03:03.558ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27452024-11-19T06:03:03.559ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27462024-11-19T06:03:03.560ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27472024-11-19T06:03:08.265ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46974
27482024-11-19T06:03:08.265ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46974 req_id = 97d7dd5a-1e2b-4c7e-8171-0e2888571921 response_code = 200 uri = /baseboard
27492024-11-19T06:03:13.520ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27502024-11-19T06:03:13.521ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27512024-11-19T06:03:13.522ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27522024-11-19T06:03:13.522ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27532024-11-19T06:03:13.523ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27542024-11-19T06:03:13.524ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27552024-11-19T06:03:13.524ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27562024-11-19T06:03:13.525ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27572024-11-19T06:03:13.550ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27582024-11-19T06:03:13.551ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27592024-11-19T06:03:13.552ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27602024-11-19T06:03:13.553ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27612024-11-19T06:03:13.556ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27622024-11-19T06:03:13.558ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27632024-11-19T06:03:13.558ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27642024-11-19T06:03:13.560ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27652024-11-19T06:03:13.561ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27662024-11-19T06:03:13.562ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
27672024-11-19T06:03:15.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34399
27682024-11-19T06:03:15.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34399 req_id = 6954de76-f757-4770-ad1c-6ecc9afc7450 response_code = 200 uri = /vpc-routes
27692024-11-19T06:03:15.127ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
27702024-11-19T06:03:15.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34399 req_id = 238a210c-2944-428e-91ee-7ec8fe6282c3 response_code = 204 uri = /eip-gateways
27712024-11-19T06:03:15.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34399 req_id = 74f352ed-08f5-421c-a430-bc0ab620a55b response_code = 204 uri = /vpc-routes
27722024-11-19T06:03:15.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50398
27732024-11-19T06:03:15.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50398 req_id = 3faedaf6-f940-4cfa-b1f8-3775509a0f31 response_code = 200 uri = /v2p
27742024-11-19T06:03:15.406ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55337
27752024-11-19T06:03:15.407ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27762024-11-19T06:03:15.407ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27772024-11-19T06:03:15.407ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/omicron-zones.json file = common/src/ledger.rs:177
27782024-11-19T06:03:15.408ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/omicron-zones.json file = common/src/ledger.rs:177
27792024-11-19T06:03:15.425ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27802024-11-19T06:03:15.425ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8f726703-f78a-4246-88d2-b12195677e7c
27812024-11-19T06:03:15.438ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61452
27822024-11-19T06:03:15.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61452 req_id = 6d60e707-15c6-4f7b-aaa6-b903453f9a59 response_code = 200 uri = /vpc-routes
27832024-11-19T06:03:15.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49294
27842024-11-19T06:03:15.441ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27852024-11-19T06:03:15.466ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27862024-11-19T06:03:15.466ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15
27872024-11-19T06:03:15.498ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27882024-11-19T06:03:15.505ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27892024-11-19T06:03:15.505ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_35a1f44b-de46-41ee-ad1e-96313ecc15b9
27902024-11-19T06:03:15.510ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
27912024-11-19T06:03:15.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 641 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61452 req_id = 2637527b-e0fc-4fb7-840e-b345fb09f083 response_code = 204 uri = /eip-gateways
27922024-11-19T06:03:15.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 372 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61452 req_id = 86cb92cb-64d2-4312-9a54-8da56257d7a7 response_code = 204 uri = /vpc-routes
27932024-11-19T06:03:15.541ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27942024-11-19T06:03:15.541ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c5fdd794-3bc8-49cb-89e3-b36cc4eb9892
27952024-11-19T06:03:15.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136564 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49294 req_id = 858e406f-c379-4376-a230-3fe9cf42e8f1 response_code = 204 uri = /switch-ports
27962024-11-19T06:03:15.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49294 req_id = 70dc92f2-aa38-426c-92ca-5e0039bc77da response_code = 200 uri = /network-bootstore-config
27972024-11-19T06:03:15.582ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27982024-11-19T06:03:15.582ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b94b817f-675d-49a5-b1c9-b8c4fb8b401d
27992024-11-19T06:03:15.594ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64611
28002024-11-19T06:03:15.597ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35746
28012024-11-19T06:03:15.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35746 req_id = b3533630-2190-4131-8805-cf5064bebd67 response_code = 200 uri = /vpc-routes
28022024-11-19T06:03:15.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44987
28032024-11-19T06:03:15.598ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28042024-11-19T06:03:15.604ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28052024-11-19T06:03:15.604ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28062024-11-19T06:03:15.604ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/omicron-zones.json file = common/src/ledger.rs:177
28072024-11-19T06:03:15.610ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/omicron-zones.json file = common/src/ledger.rs:177
28082024-11-19T06:03:15.622ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28092024-11-19T06:03:15.623ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5c871af8-68dd-4136-bfd3-234cd1e72e1e
28102024-11-19T06:03:15.629ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
28112024-11-19T06:03:15.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6422 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35746 req_id = 408ff5ca-5d13-4a00-9e9a-f6f2ee74e8a8 response_code = 204 uri = /eip-gateways
28122024-11-19T06:03:15.639ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28132024-11-19T06:03:15.640ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8f726703-f78a-4246-88d2-b12195677e7c
28142024-11-19T06:03:15.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42082
28152024-11-19T06:03:15.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42082 req_id = 2758cbb6-2233-4b2c-9eb6-abc81ada4096 response_code = 200 uri = /v2p
28162024-11-19T06:03:15.651ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48876
28172024-11-19T06:03:15.651ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 256f247e-4de6-49b2-a232-cf77d0f780e4, kind: Service { id: bb4d79db-b332-4dd4-8e52-fcecf48e448d }, name: Name("external-dns-bb4d79db-b332-4dd4-8e52-fcecf48e448d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 218])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d1b85f63-706d-4ace-ba0e-597770a5fb36, kind: Service { id: c29d6cd6-2a42-4173-b7b2-1125c4e42dc9 }, name: Name("external-dns-c29d6cd6-2a42-4173-b7b2-1125c4e42dc9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 99])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 06879b4d-7caa-4269-9225-8fc437aa415d, kind: Service { id: 67225c0a-0a53-4e08-a753-a917553c7b98 }, name: Name("nexus-67225c0a-0a53-4e08-a753-a917553c7b98"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 16dfcd1a-39ad-4d73-ad80-575882a493b7, kind: Service { id: 3ad742bb-4404-4a65-bfcd-5935cc6c6458 }, name: Name("nexus-3ad742bb-4404-4a65-bfcd-5935cc6c6458"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff00a53c-dab4-46e5-9026-b7386ebdd8fd, kind: Service { id: 8318957c-506a-4355-8689-147ab934628e }, name: Name("nexus-8318957c-506a-4355-8689-147ab934628e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28182024-11-19T06:03:15.651ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28192024-11-19T06:03:15.651ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28202024-11-19T06:03:15.651ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28212024-11-19T06:03:15.651ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28222024-11-19T06:03:15.651ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28232024-11-19T06:03:15.651ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28242024-11-19T06:03:15.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 452 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48876 req_id = 0d1aec9e-3e98-43f3-9b50-2e9f3928d1c1 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28252024-11-19T06:03:15.653ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28262024-11-19T06:03:15.674ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28272024-11-19T06:03:15.675ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15
28282024-11-19T06:03:15.689ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2d68dcb6-83b9-430c-b8d8-fa955e9efd1b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28292024-11-19T06:03:15.689ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2d68dcb6-83b9-430c-b8d8-fa955e9efd1b
28302024-11-19T06:03:15.708ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28312024-11-19T06:03:15.708ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_35a1f44b-de46-41ee-ad1e-96313ecc15b9
28322024-11-19T06:03:15.725ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28332024-11-19T06:03:15.725ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9
28342024-11-19T06:03:15.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131513 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44987 req_id = 0be320d2-e55e-4530-a1db-de5dad8d4867 response_code = 204 uri = /switch-ports
28352024-11-19T06:03:15.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44987 req_id = eb6cfb76-8edf-4524-992a-fe38a94c92e0 response_code = 200 uri = /network-bootstore-config
28362024-11-19T06:03:15.749ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64425
28372024-11-19T06:03:15.749ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28382024-11-19T06:03:15.749ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28392024-11-19T06:03:15.749ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/config/omicron-zones.json file = common/src/ledger.rs:177
28402024-11-19T06:03:15.750ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/309add57-857d-42cd-8f12-8351d275a791/config/omicron-zones.json file = common/src/ledger.rs:177
28412024-11-19T06:03:15.756ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28422024-11-19T06:03:15.756ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_685f3f58-b5f9-4e42-8994-bdac247f87cd
28432024-11-19T06:03:15.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62435
28442024-11-19T06:03:15.762ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 256f247e-4de6-49b2-a232-cf77d0f780e4, kind: Service { id: bb4d79db-b332-4dd4-8e52-fcecf48e448d }, name: Name("external-dns-bb4d79db-b332-4dd4-8e52-fcecf48e448d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 218])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d1b85f63-706d-4ace-ba0e-597770a5fb36, kind: Service { id: c29d6cd6-2a42-4173-b7b2-1125c4e42dc9 }, name: Name("external-dns-c29d6cd6-2a42-4173-b7b2-1125c4e42dc9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 99])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 06879b4d-7caa-4269-9225-8fc437aa415d, kind: Service { id: 67225c0a-0a53-4e08-a753-a917553c7b98 }, name: Name("nexus-67225c0a-0a53-4e08-a753-a917553c7b98"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 16dfcd1a-39ad-4d73-ad80-575882a493b7, kind: Service { id: 3ad742bb-4404-4a65-bfcd-5935cc6c6458 }, name: Name("nexus-3ad742bb-4404-4a65-bfcd-5935cc6c6458"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff00a53c-dab4-46e5-9026-b7386ebdd8fd, kind: Service { id: 8318957c-506a-4355-8689-147ab934628e }, name: Name("nexus-8318957c-506a-4355-8689-147ab934628e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28452024-11-19T06:03:15.762ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28462024-11-19T06:03:15.762ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28472024-11-19T06:03:15.762ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28482024-11-19T06:03:15.762ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28492024-11-19T06:03:15.762ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28502024-11-19T06:03:15.762ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28512024-11-19T06:03:15.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 623 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62435 req_id = 86398196-31e5-48f9-9f48-751d1ba9253e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28522024-11-19T06:03:15.771ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28532024-11-19T06:03:15.771ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c5fdd794-3bc8-49cb-89e3-b36cc4eb9892
28542024-11-19T06:03:15.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 369985 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55337 req_id = ee8cfc77-eab3-4aca-a5c8-70d009adabbe response_code = 200 uri = /inventory
28552024-11-19T06:03:15.785ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8f726703-f78a-4246-88d2-b12195677e7c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28562024-11-19T06:03:15.785ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8f726703-f78a-4246-88d2-b12195677e7c
28572024-11-19T06:03:15.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37632
28582024-11-19T06:03:15.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37632 req_id = b83bbbb2-2171-402e-8b5d-123b51fe4467 response_code = 200 uri = /v2p
28592024-11-19T06:03:15.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35746 req_id = 6fa73029-911d-4945-b9ca-03074fa7d698 response_code = 204 uri = /vpc-routes
28602024-11-19T06:03:15.807ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28612024-11-19T06:03:15.808ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b94b817f-675d-49a5-b1c9-b8c4fb8b401d
28622024-11-19T06:03:15.826ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28632024-11-19T06:03:15.826ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15
28642024-11-19T06:03:15.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45200
28652024-11-19T06:03:15.841ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28662024-11-19T06:03:15.865ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28672024-11-19T06:03:15.866ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5c871af8-68dd-4136-bfd3-234cd1e72e1e
28682024-11-19T06:03:15.886ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 35a1f44b-de46-41ee-ad1e-96313ecc15b9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28692024-11-19T06:03:15.886ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_35a1f44b-de46-41ee-ad1e-96313ecc15b9
28702024-11-19T06:03:15.891ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28712024-11-19T06:03:15.923ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c5fdd794-3bc8-49cb-89e3-b36cc4eb9892 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28722024-11-19T06:03:15.923ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c5fdd794-3bc8-49cb-89e3-b36cc4eb9892
28732024-11-19T06:03:15.943ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2d68dcb6-83b9-430c-b8d8-fa955e9efd1b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28742024-11-19T06:03:15.943ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2d68dcb6-83b9-430c-b8d8-fa955e9efd1b
28752024-11-19T06:03:15.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62284
28762024-11-19T06:03:15.960ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 256f247e-4de6-49b2-a232-cf77d0f780e4, kind: Service { id: bb4d79db-b332-4dd4-8e52-fcecf48e448d }, name: Name("external-dns-bb4d79db-b332-4dd4-8e52-fcecf48e448d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 218])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d1b85f63-706d-4ace-ba0e-597770a5fb36, kind: Service { id: c29d6cd6-2a42-4173-b7b2-1125c4e42dc9 }, name: Name("external-dns-c29d6cd6-2a42-4173-b7b2-1125c4e42dc9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 99])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 06879b4d-7caa-4269-9225-8fc437aa415d, kind: Service { id: 67225c0a-0a53-4e08-a753-a917553c7b98 }, name: Name("nexus-67225c0a-0a53-4e08-a753-a917553c7b98"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 16dfcd1a-39ad-4d73-ad80-575882a493b7, kind: Service { id: 3ad742bb-4404-4a65-bfcd-5935cc6c6458 }, name: Name("nexus-3ad742bb-4404-4a65-bfcd-5935cc6c6458"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff00a53c-dab4-46e5-9026-b7386ebdd8fd, kind: Service { id: 8318957c-506a-4355-8689-147ab934628e }, name: Name("nexus-8318957c-506a-4355-8689-147ab934628e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28772024-11-19T06:03:15.960ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28782024-11-19T06:03:15.960ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28792024-11-19T06:03:15.960ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28802024-11-19T06:03:15.960ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28812024-11-19T06:03:15.960ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28822024-11-19T06:03:15.960ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28832024-11-19T06:03:15.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 407 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62284 req_id = 563841e3-5fc0-42b2-8fa8-5167968b69a0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28842024-11-19T06:03:15.968ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b94b817f-675d-49a5-b1c9-b8c4fb8b401d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28852024-11-19T06:03:15.968ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b94b817f-675d-49a5-b1c9-b8c4fb8b401d
28862024-11-19T06:03:15.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137383 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45200 req_id = 08bf0c2a-5464-44fa-8c4a-b44a4878c2cf response_code = 204 uri = /switch-ports
28872024-11-19T06:03:15.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45200 req_id = f59ae31c-c26c-4957-9ac2-53c9882768bf response_code = 200 uri = /network-bootstore-config
28882024-11-19T06:03:15.990ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28892024-11-19T06:03:15.990ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9
28902024-11-19T06:03:16.006ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c871af8-68dd-4136-bfd3-234cd1e72e1e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28912024-11-19T06:03:16.006ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5c871af8-68dd-4136-bfd3-234cd1e72e1e
28922024-11-19T06:03:16.034ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2d68dcb6-83b9-430c-b8d8-fa955e9efd1b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28932024-11-19T06:03:16.034ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2d68dcb6-83b9-430c-b8d8-fa955e9efd1b
28942024-11-19T06:03:16.047ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28952024-11-19T06:03:16.047ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_685f3f58-b5f9-4e42-8994-bdac247f87cd
28962024-11-19T06:03:16.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 465982 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64611 req_id = cc8cba6a-13f6-4c36-bb1d-cce57ae9c97d response_code = 200 uri = /inventory
28972024-11-19T06:03:16.064ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28982024-11-19T06:03:16.064ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9
28992024-11-19T06:03:16.088ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 685f3f58-b5f9-4e42-8994-bdac247f87cd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29002024-11-19T06:03:16.088ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_685f3f58-b5f9-4e42-8994-bdac247f87cd
29012024-11-19T06:03:16.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 352480 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64425 req_id = fda68310-639d-4951-83d2-6a28058556e1 response_code = 200 uri = /inventory
29022024-11-19T06:03:23.525ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29032024-11-19T06:03:23.526ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29042024-11-19T06:03:23.527ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29052024-11-19T06:03:23.527ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29062024-11-19T06:03:23.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29072024-11-19T06:03:23.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29082024-11-19T06:03:23.529ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29092024-11-19T06:03:23.530ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29102024-11-19T06:03:23.552ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29112024-11-19T06:03:23.553ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29122024-11-19T06:03:23.554ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29132024-11-19T06:03:23.554ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29142024-11-19T06:03:23.559ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29152024-11-19T06:03:23.560ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29162024-11-19T06:03:23.561ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29172024-11-19T06:03:23.562ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29182024-11-19T06:03:23.563ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29192024-11-19T06:03:23.564ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29202024-11-19T06:03:33.530ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29212024-11-19T06:03:33.531ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29222024-11-19T06:03:33.532ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29232024-11-19T06:03:33.532ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29242024-11-19T06:03:33.533ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29252024-11-19T06:03:33.533ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29262024-11-19T06:03:33.534ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29272024-11-19T06:03:33.535ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29282024-11-19T06:03:33.555ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29292024-11-19T06:03:33.556ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29302024-11-19T06:03:33.556ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29312024-11-19T06:03:33.557ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29322024-11-19T06:03:33.561ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29332024-11-19T06:03:33.562ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29342024-11-19T06:03:33.563ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29352024-11-19T06:03:33.564ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29362024-11-19T06:03:33.564ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29372024-11-19T06:03:33.565ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29382024-11-19T06:03:38.299ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56499
29392024-11-19T06:03:38.299ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56499 req_id = 4836963d-6017-4c76-b575-bbffb81b2bf0 response_code = 200 uri = /baseboard
29402024-11-19T06:03:43.534ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29412024-11-19T06:03:43.535ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29422024-11-19T06:03:43.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29432024-11-19T06:03:43.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29442024-11-19T06:03:43.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29452024-11-19T06:03:43.538ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29462024-11-19T06:03:43.538ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29472024-11-19T06:03:43.539ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29482024-11-19T06:03:43.557ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29492024-11-19T06:03:43.557ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29502024-11-19T06:03:43.558ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29512024-11-19T06:03:43.559ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29522024-11-19T06:03:43.564ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29532024-11-19T06:03:43.565ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29542024-11-19T06:03:43.566ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29552024-11-19T06:03:43.567ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29562024-11-19T06:03:43.567ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29572024-11-19T06:03:43.568ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29582024-11-19T06:03:44.952ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50812
29592024-11-19T06:03:44.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50812 req_id = 204a3911-0b7e-420a-ad3d-4212f6a04243 response_code = 200 uri = /vpc-routes
29602024-11-19T06:03:45.000ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
29612024-11-19T06:03:45.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50812 req_id = a2af9bd7-0bb9-4993-a45b-a467e09a0b55 response_code = 204 uri = /eip-gateways
29622024-11-19T06:03:45.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50812 req_id = 9759a6e4-dd22-4370-aeb5-520b333907e0 response_code = 204 uri = /vpc-routes
29632024-11-19T06:03:45.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63673
29642024-11-19T06:03:45.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63673 req_id = 9e75e4e2-0c05-4af0-9c54-6bf5fde0f466 response_code = 200 uri = /v2p
29652024-11-19T06:03:45.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54610
29662024-11-19T06:03:45.042ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29672024-11-19T06:03:45.098ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29682024-11-19T06:03:45.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131298 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54610 req_id = d26a6b29-fa16-4483-acda-5a06eb44a2c5 response_code = 204 uri = /switch-ports
29692024-11-19T06:03:45.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54610 req_id = b6156665-4df3-4b9a-b732-dc9fad29e439 response_code = 200 uri = /network-bootstore-config
29702024-11-19T06:03:45.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41263
29712024-11-19T06:03:45.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41263 req_id = be6ce6a4-6e55-49fd-997c-e1a4d40b1687 response_code = 200 uri = /vpc-routes
29722024-11-19T06:03:45.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60183
29732024-11-19T06:03:45.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60183 req_id = 6629bf45-b8ea-4519-a157-fae11abc7d53 response_code = 200 uri = /v2p
29742024-11-19T06:03:45.295ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
29752024-11-19T06:03:45.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41263 req_id = 885a3965-fae2-44af-9339-bd942c821cf6 response_code = 204 uri = /eip-gateways
29762024-11-19T06:03:45.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41263 req_id = 6fcf271c-534e-4378-b4db-487d2cafc6c6 response_code = 204 uri = /vpc-routes
29772024-11-19T06:03:45.334ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49673
29782024-11-19T06:03:45.334ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29792024-11-19T06:03:45.378ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29802024-11-19T06:03:45.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101305 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49673 req_id = 29ed8840-9c24-4532-97cc-78f30fe78c9d response_code = 204 uri = /switch-ports
29812024-11-19T06:03:45.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49673 req_id = bcf9951a-b486-4d6b-8d9a-bb58884ae12c response_code = 200 uri = /network-bootstore-config
29822024-11-19T06:03:45.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54258
29832024-11-19T06:03:45.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54258 req_id = afc9e061-e5b8-4ec0-bfb9-3eb62ef10288 response_code = 200 uri = /vpc-routes
29842024-11-19T06:03:45.526ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
29852024-11-19T06:03:45.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54258 req_id = 060a73eb-5947-4999-a3e9-351b8495d761 response_code = 204 uri = /eip-gateways
29862024-11-19T06:03:45.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54258 req_id = 2293857b-4c86-495d-b937-74da60b22e53 response_code = 204 uri = /vpc-routes
29872024-11-19T06:03:45.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63671
29882024-11-19T06:03:45.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63671 req_id = e753aa7e-e169-4d53-8eed-9c101afad27a response_code = 200 uri = /v2p
29892024-11-19T06:03:45.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37585
29902024-11-19T06:03:45.585ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29912024-11-19T06:03:45.627ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29922024-11-19T06:03:45.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99479 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37585 req_id = 21dbe1d6-8e78-4dfd-a2b4-1cca5b6c80fc response_code = 204 uri = /switch-ports
29932024-11-19T06:03:45.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37585 req_id = 3a823b4d-2f04-432b-aa33-240f3c18619a response_code = 200 uri = /network-bootstore-config
29942024-11-19T06:03:53.538ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29952024-11-19T06:03:53.539ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29962024-11-19T06:03:53.540ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29972024-11-19T06:03:53.540ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29982024-11-19T06:03:53.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
29992024-11-19T06:03:53.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30002024-11-19T06:03:53.542ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30012024-11-19T06:03:53.542ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30022024-11-19T06:03:53.559ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30032024-11-19T06:03:53.560ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30042024-11-19T06:03:53.561ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30052024-11-19T06:03:53.561ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30062024-11-19T06:03:53.566ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30072024-11-19T06:03:53.568ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30082024-11-19T06:03:53.568ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30092024-11-19T06:03:53.569ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30102024-11-19T06:03:53.570ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30112024-11-19T06:03:53.571ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30122024-11-19T06:04:03.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30132024-11-19T06:04:03.544ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30142024-11-19T06:04:03.544ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30152024-11-19T06:04:03.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30162024-11-19T06:04:03.546ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30172024-11-19T06:04:03.546ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30182024-11-19T06:04:03.547ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30192024-11-19T06:04:03.547ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30202024-11-19T06:04:03.561ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30212024-11-19T06:04:03.562ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30222024-11-19T06:04:03.564ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30232024-11-19T06:04:03.564ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30242024-11-19T06:04:03.568ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30252024-11-19T06:04:03.569ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30262024-11-19T06:04:03.570ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30272024-11-19T06:04:03.571ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30282024-11-19T06:04:03.572ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30292024-11-19T06:04:03.572ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30302024-11-19T06:04:08.335ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38222
30312024-11-19T06:04:08.335ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38222 req_id = aa42da57-e99e-4ff5-915f-5e16996b07b9 response_code = 200 uri = /baseboard
30322024-11-19T06:04:13.547ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30332024-11-19T06:04:13.548ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30342024-11-19T06:04:13.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30352024-11-19T06:04:13.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30362024-11-19T06:04:13.550ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30372024-11-19T06:04:13.550ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30382024-11-19T06:04:13.551ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30392024-11-19T06:04:13.552ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30402024-11-19T06:04:13.563ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30412024-11-19T06:04:13.564ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30422024-11-19T06:04:13.565ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30432024-11-19T06:04:13.567ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30442024-11-19T06:04:13.569ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30452024-11-19T06:04:13.571ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30462024-11-19T06:04:13.571ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30472024-11-19T06:04:13.573ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30482024-11-19T06:04:13.574ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30492024-11-19T06:04:13.575ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30502024-11-19T06:04:15.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50519
30512024-11-19T06:04:15.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50519 req_id = 3a28cf3f-54d2-413b-a074-e0a2df408568 response_code = 200 uri = /vpc-routes
30522024-11-19T06:04:15.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58642
30532024-11-19T06:04:15.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58642 req_id = 70e8c34a-a634-44e2-8a6f-cb2bafc92ebf response_code = 200 uri = /v2p
30542024-11-19T06:04:15.218ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
30552024-11-19T06:04:15.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50519 req_id = 5d780eee-8891-4d35-b149-dfb90a4377e5 response_code = 204 uri = /eip-gateways
30562024-11-19T06:04:15.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50519 req_id = 03b00933-c7d7-43e7-911c-f0238db3876e response_code = 204 uri = /vpc-routes
30572024-11-19T06:04:15.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37305
30582024-11-19T06:04:15.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37305 req_id = c528b436-e2f3-4201-b2c8-60a016504db7 response_code = 200 uri = /vpc-routes
30592024-11-19T06:04:15.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65534
30602024-11-19T06:04:15.424ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30612024-11-19T06:04:15.479ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30622024-11-19T06:04:15.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136488 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65534 req_id = 87446d83-d107-4d82-9a6b-40f04390f9a0 response_code = 204 uri = /switch-ports
30632024-11-19T06:04:15.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52211
30642024-11-19T06:04:15.561ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
30652024-11-19T06:04:15.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65534 req_id = 3d54745e-bf2e-42bc-a65a-d863b6673f3f response_code = 200 uri = /network-bootstore-config
30662024-11-19T06:04:15.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37305 req_id = 06574dc7-51d8-4fab-9aa1-84f005ad9775 response_code = 204 uri = /eip-gateways
30672024-11-19T06:04:15.562ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30682024-11-19T06:04:15.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 411 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37305 req_id = 8c55cc31-0f96-4e0e-bb59-fa568a87f7b3 response_code = 204 uri = /vpc-routes
30692024-11-19T06:04:15.605ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51834
30702024-11-19T06:04:15.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51834 req_id = 81192537-1923-4ee6-85c5-9f381e7c147b response_code = 200 uri = /vpc-routes
30712024-11-19T06:04:15.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56781
30722024-11-19T06:04:15.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56781 req_id = 2ec5c62e-00a4-46d9-942f-dcde96a632c0 response_code = 200 uri = /v2p
30732024-11-19T06:04:15.624ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30742024-11-19T06:04:15.680ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
30752024-11-19T06:04:15.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51834 req_id = 40c797a6-13c5-4dc7-8b72-7dd341455388 response_code = 204 uri = /eip-gateways
30762024-11-19T06:04:15.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51834 req_id = 67f96f22-a51b-4fd9-ab33-535303f1ef88 response_code = 204 uri = /vpc-routes
30772024-11-19T06:04:15.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171647 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52211 req_id = cc0a82e0-0b4e-4b15-ad64-54b991bbda62 response_code = 204 uri = /switch-ports
30782024-11-19T06:04:15.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52211 req_id = 7f06f705-b402-4fc6-af7f-cc5f7b31e9b1 response_code = 200 uri = /network-bootstore-config
30792024-11-19T06:04:15.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61906
30802024-11-19T06:04:15.853ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30812024-11-19T06:04:15.895ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30822024-11-19T06:04:15.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101615 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61906 req_id = 608015fd-0883-433b-842d-e8c1718c8c16 response_code = 204 uri = /switch-ports
30832024-11-19T06:04:15.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57371
30842024-11-19T06:04:15.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57371 req_id = 63e1aa6b-a0da-4849-8fbc-9a718f05c6ad response_code = 200 uri = /v2p
30852024-11-19T06:04:15.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61906 req_id = b70c374d-a361-4f77-aae9-2455d0c150de response_code = 200 uri = /network-bootstore-config
30862024-11-19T06:04:23.552ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30872024-11-19T06:04:23.553ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30882024-11-19T06:04:23.554ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30892024-11-19T06:04:23.554ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30902024-11-19T06:04:23.555ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30912024-11-19T06:04:23.555ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30922024-11-19T06:04:23.556ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30932024-11-19T06:04:23.557ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30942024-11-19T06:04:23.565ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30952024-11-19T06:04:23.566ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30962024-11-19T06:04:23.567ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30972024-11-19T06:04:23.569ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30982024-11-19T06:04:23.571ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
30992024-11-19T06:04:23.573ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31002024-11-19T06:04:23.573ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31012024-11-19T06:04:23.575ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31022024-11-19T06:04:23.575ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31032024-11-19T06:04:23.577ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31042024-11-19T06:04:33.556ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31052024-11-19T06:04:33.557ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31062024-11-19T06:04:33.558ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31072024-11-19T06:04:33.558ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31082024-11-19T06:04:33.559ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31092024-11-19T06:04:33.559ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31102024-11-19T06:04:33.560ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31112024-11-19T06:04:33.561ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31122024-11-19T06:04:33.567ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31132024-11-19T06:04:33.568ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31142024-11-19T06:04:33.569ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31152024-11-19T06:04:33.571ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31162024-11-19T06:04:33.573ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31172024-11-19T06:04:33.575ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31182024-11-19T06:04:33.575ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31192024-11-19T06:04:33.576ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31202024-11-19T06:04:33.577ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31212024-11-19T06:04:33.579ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31222024-11-19T06:04:38.370ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64889
31232024-11-19T06:04:38.370ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64889 req_id = b5131d04-844a-413f-86d6-7a5854a97a12 response_code = 200 uri = /baseboard
31242024-11-19T06:04:43.560ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31252024-11-19T06:04:43.561ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31262024-11-19T06:04:43.562ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31272024-11-19T06:04:43.563ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31282024-11-19T06:04:43.563ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31292024-11-19T06:04:43.564ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31302024-11-19T06:04:43.564ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31312024-11-19T06:04:43.565ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31322024-11-19T06:04:43.569ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31332024-11-19T06:04:43.570ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31342024-11-19T06:04:43.571ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31352024-11-19T06:04:43.572ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31362024-11-19T06:04:43.575ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31372024-11-19T06:04:43.577ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31382024-11-19T06:04:43.577ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31392024-11-19T06:04:43.579ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31402024-11-19T06:04:43.579ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31412024-11-19T06:04:43.581ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31422024-11-19T06:04:44.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55786
31432024-11-19T06:04:44.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55786 req_id = 3f3e5f75-ab84-4cd7-ac87-2fc30d269606 response_code = 200 uri = /vpc-routes
31442024-11-19T06:04:45.004ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
31452024-11-19T06:04:45.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55786 req_id = 7b50f51c-e358-484b-b09d-76fe9d37481e response_code = 204 uri = /eip-gateways
31462024-11-19T06:04:45.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55786 req_id = 3cc89020-4a9a-4891-a82e-6b62f41da605 response_code = 204 uri = /vpc-routes
31472024-11-19T06:04:45.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47806
31482024-11-19T06:04:45.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47806 req_id = d89e4772-9d10-4f65-b75d-9205ba1bd495 response_code = 200 uri = /v2p
31492024-11-19T06:04:45.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49046
31502024-11-19T06:04:45.113ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31512024-11-19T06:04:45.154ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31522024-11-19T06:04:45.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127430 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49046 req_id = ef5ef376-7218-4576-a0ed-5f08e4990a4f response_code = 204 uri = /switch-ports
31532024-11-19T06:04:45.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38463
31542024-11-19T06:04:45.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38463 req_id = 8b46b89d-0b24-42c2-af58-51edfebd615c response_code = 200 uri = /vpc-routes
31552024-11-19T06:04:45.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49046 req_id = 678d477b-ebe6-4906-9b89-74db3b3782dc response_code = 200 uri = /network-bootstore-config
31562024-11-19T06:04:45.298ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
31572024-11-19T06:04:45.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38463 req_id = 209ba5cf-50a8-4290-9d7d-d3653333e2a3 response_code = 204 uri = /eip-gateways
31582024-11-19T06:04:45.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38463 req_id = 7542848d-35de-4bba-ac50-d46c2649f28a response_code = 204 uri = /vpc-routes
31592024-11-19T06:04:45.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52765
31602024-11-19T06:04:45.343ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31612024-11-19T06:04:45.392ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31622024-11-19T06:04:45.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120861 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52765 req_id = 71255dce-49d7-4896-bb37-2cce201cda5a response_code = 204 uri = /switch-ports
31632024-11-19T06:04:45.464ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42030
31642024-11-19T06:04:45.464ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41892
31652024-11-19T06:04:45.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41892 req_id = eae0fbbf-c8ad-46f8-9153-cf1909474641 response_code = 200 uri = /v2p
31662024-11-19T06:04:45.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42030 req_id = ff429b0d-44fa-4848-8b10-fcbb80af0f66 response_code = 200 uri = /vpc-routes
31672024-11-19T06:04:45.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52765 req_id = 1c00d6df-34f9-4a30-9bc4-7b9d2d88eb9a response_code = 200 uri = /network-bootstore-config
31682024-11-19T06:04:45.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35635
31692024-11-19T06:04:45.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35635 req_id = e35a166f-0c05-4a7f-bbc2-40ee9689d17d response_code = 200 uri = /v2p
31702024-11-19T06:04:45.507ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
31712024-11-19T06:04:45.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42030 req_id = 04b771ab-10c9-4fec-9338-ce7e21943f67 response_code = 204 uri = /eip-gateways
31722024-11-19T06:04:45.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42030 req_id = f1f613f9-8099-4567-bf20-4a61b2a1ea00 response_code = 204 uri = /vpc-routes
31732024-11-19T06:04:45.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61917
31742024-11-19T06:04:45.534ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31752024-11-19T06:04:45.577ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31762024-11-19T06:04:45.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107528 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61917 req_id = f171345c-0d3b-4bae-a252-80a1ec4a8495 response_code = 204 uri = /switch-ports
31772024-11-19T06:04:45.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61917 req_id = 287ff448-02a5-4f42-8ba4-93e5d40e6329 response_code = 200 uri = /network-bootstore-config
31782024-11-19T06:04:53.564ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31792024-11-19T06:04:53.565ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31802024-11-19T06:04:53.566ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31812024-11-19T06:04:53.566ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31822024-11-19T06:04:53.567ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31832024-11-19T06:04:53.567ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31842024-11-19T06:04:53.568ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31852024-11-19T06:04:53.569ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31862024-11-19T06:04:53.571ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31872024-11-19T06:04:53.572ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31882024-11-19T06:04:53.573ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31892024-11-19T06:04:53.573ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31902024-11-19T06:04:53.577ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31912024-11-19T06:04:53.578ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31922024-11-19T06:04:53.579ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31932024-11-19T06:04:53.580ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31942024-11-19T06:04:53.581ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31952024-11-19T06:04:53.583ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31962024-11-19T06:05:03.568ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31972024-11-19T06:05:03.569ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31982024-11-19T06:05:03.570ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
31992024-11-19T06:05:03.571ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32002024-11-19T06:05:03.571ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32012024-11-19T06:05:03.572ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32022024-11-19T06:05:03.572ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32032024-11-19T06:05:03.573ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32042024-11-19T06:05:03.574ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32052024-11-19T06:05:03.574ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32062024-11-19T06:05:03.575ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32072024-11-19T06:05:03.576ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32082024-11-19T06:05:03.579ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32092024-11-19T06:05:03.581ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32102024-11-19T06:05:03.581ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32112024-11-19T06:05:03.583ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32122024-11-19T06:05:03.583ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32132024-11-19T06:05:03.584ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32142024-11-19T06:05:08.402ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34323
32152024-11-19T06:05:08.402ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34323 req_id = e5531f71-9070-40e8-8b4d-55aedcd5274b response_code = 200 uri = /baseboard
32162024-11-19T06:05:09.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52798
32172024-11-19T06:05:09.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52798 req_id = 131df7a2-6cb1-4bdf-aa03-06281c496b40 response_code = 200 uri = /v2p
32182024-11-19T06:05:09.136ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(11321002) }
32192024-11-19T06:05:09.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52798 req_id = 05d89f11-a8aa-4dee-8a65-b1009b9a13f1 response_code = 204 uri = /v2p
32202024-11-19T06:05:09.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62513
32212024-11-19T06:05:09.233ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 9058fd45-e28a-4912-b28e-6057fa9506fb, kind: Instance { id: d2ae3154-15d2-4272-ab40-624b3239c2e7 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11321002), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9058fd45-e28a-4912-b28e-6057fa9506fb, kind: Instance { id: d2ae3154-15d2-4272-ab40-624b3239c2e7 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11321002), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9058fd45-e28a-4912-b28e-6057fa9506fb, kind: Instance { id: d2ae3154-15d2-4272-ab40-624b3239c2e7 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11321002), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(11321002))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9058fd45-e28a-4912-b28e-6057fa9506fb, kind: Instance { id: d2ae3154-15d2-4272-ab40-624b3239c2e7 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11321002), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-61c6d49a04e", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 79671432-4fdd-44bf-b520-ca176e4e13f7, read_only_parent: Some(Volume { block_size: 512, id: 7c6f8c90-2812-4cf7-8990-d3d5752e6de6, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: c970815e-e20a-48b0-a083-f7957c85adc0, key: Some("jOckhe3W+f0sWIjuqbxxXRCqrbdOx5aqiTwJtsx4mDU="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::14]:19001", "[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::17]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 79671432-4fdd-44bf-b520-ca176e4e13f7, key: Some("dO0JVdYkOkbr6mM1VNJA54dtDT/gLbvhuOP4abDR1J4="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19000", "[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::15]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-61c6d49a04e" }] }), cloud_init_bytes: Some(..) } instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 metadata = InstanceMetadata { silo_id: 72a1d3e6-6925-4b66-a837-17a09208a856, project_id: 6191070c-d58d-4701-8f9b-23615d95c74d } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-19T06:05:09.216917482Z }
32222024-11-19T06:05:09.233ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 migration_id = None propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836
32232024-11-19T06:05:09.233ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 migration_id = None propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 9058fd45-e28a-4912-b28e-6057fa9506fb, kind: Instance { id: d2ae3154-15d2-4272-ab40-624b3239c2e7 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11321002), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9058fd45-e28a-4912-b28e-6057fa9506fb, kind: Instance { id: d2ae3154-15d2-4272-ab40-624b3239c2e7 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11321002), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9058fd45-e28a-4912-b28e-6057fa9506fb, kind: Instance { id: d2ae3154-15d2-4272-ab40-624b3239c2e7 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11321002), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(11321002))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9058fd45-e28a-4912-b28e-6057fa9506fb, kind: Instance { id: d2ae3154-15d2-4272-ab40-624b3239c2e7 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11321002), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-61c6d49a04e", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 79671432-4fdd-44bf-b520-ca176e4e13f7, read_only_parent: Some(Volume { block_size: 512, id: 7c6f8c90-2812-4cf7-8990-d3d5752e6de6, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: c970815e-e20a-48b0-a083-f7957c85adc0, key: Some("jOckhe3W+f0sWIjuqbxxXRCqrbdOx5aqiTwJtsx4mDU="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::14]:19001", "[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::17]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 79671432-4fdd-44bf-b520-ca176e4e13f7, key: Some("dO0JVdYkOkbr6mM1VNJA54dtDT/gLbvhuOP4abDR1J4="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19000", "[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::15]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-61c6d49a04e" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-19T06:05:09.216917482Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
32242024-11-19T06:05:09.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 15443 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62513 req_id = ee9801af-e19f-4e8e-a38d-839a83360295 response_code = 200 uri = /vmms/6cf5bcc9-ddb7-474f-89b4-c76b970bc836
32252024-11-19T06:05:09.337ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62118
32262024-11-19T06:05:09.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 493 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62118 req_id = c8dbc0ef-6639-4286-a231-d2cbf06db703 response_code = 200 uri = /vmms/6cf5bcc9-ddb7-474f-89b4-c76b970bc836/state
32272024-11-19T06:05:09.339ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 11321002 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
32282024-11-19T06:05:09.339ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
32292024-11-19T06:05:09.385ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836 file = illumos-utils/src/zone.rs:325 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836
32302024-11-19T06:05:09.410ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836 file = illumos-utils/src/zone.rs:363 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836
32312024-11-19T06:05:09.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42257
32322024-11-19T06:05:09.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42257 req_id = 406e9dfe-376b-417c-89ad-9904e312569b response_code = 200 uri = /vpc-routes
32332024-11-19T06:05:09.559ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {9058fd45-e28a-4912-b28e-6057fa9506fb: {10.151.1.175: {2a7d89ac-69ee-4c06-b33c-868a39aa5892}, 10.151.1.176: {2a7d89ac-69ee-4c06-b33c-868a39aa5892}}} }
32342024-11-19T06:05:10.732ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836
32352024-11-19T06:05:10.732ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836 zone file = illumos-utils/src/running_zone.rs:488 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836 zone = oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836
32362024-11-19T06:05:10.996ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836") failed: Property not found. retry in 72.223902ms file = illumos-utils/src/svc.rs:36 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836 zone = oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836
32372024-11-19T06:05:11.087ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836") failed: Property not found. retry in 100.300497ms file = illumos-utils/src/svc.rs:36 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836 zone = oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836
32382024-11-19T06:05:11.208ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836") failed: Property not found. retry in 148.020217ms file = illumos-utils/src/svc.rs:36 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836 zone = oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836
32392024-11-19T06:05:11.371ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836") failed: Property not found. retry in 326.659351ms file = illumos-utils/src/svc.rs:36 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836 zone = oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836
32402024-11-19T06:05:11.716ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836") failed: Property not found. retry in 1.118013736s file = illumos-utils/src/svc.rs:36 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836 zone = oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836
32412024-11-19T06:05:12.848ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836") failed: Property not found. retry in 1.129700795s file = illumos-utils/src/svc.rs:36 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836 zone = oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836
32422024-11-19T06:05:13.573ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32432024-11-19T06:05:13.573ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32442024-11-19T06:05:13.574ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32452024-11-19T06:05:13.575ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32462024-11-19T06:05:13.575ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32472024-11-19T06:05:13.576ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32482024-11-19T06:05:13.576ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32492024-11-19T06:05:13.577ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32502024-11-19T06:05:13.578ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32512024-11-19T06:05:13.578ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32522024-11-19T06:05:13.579ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32532024-11-19T06:05:13.579ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32542024-11-19T06:05:13.581ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32552024-11-19T06:05:13.583ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32562024-11-19T06:05:13.583ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32572024-11-19T06:05:13.584ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32582024-11-19T06:05:13.585ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32592024-11-19T06:05:13.586ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
32602024-11-19T06:05:13.993ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836") failed: Property not found. retry in 722.232409ms file = illumos-utils/src/svc.rs:36 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836 zone = oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836
32612024-11-19T06:05:14.729ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836") failed: Property not found. retry in 928.664662ms file = illumos-utils/src/svc.rs:36 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836 zone = oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836
32622024-11-19T06:05:15.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60408
32632024-11-19T06:05:15.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51017
32642024-11-19T06:05:15.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51095
32652024-11-19T06:05:15.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51095 req_id = 3cd1bdfa-c008-4b9b-a5f0-415aaa655b34 response_code = 200 uri = /vpc-routes
32662024-11-19T06:05:15.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62897
32672024-11-19T06:05:15.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62897 req_id = 5d0ab34d-64e5-4208-a38f-42f53b061135 response_code = 200 uri = /vpc-routes
32682024-11-19T06:05:15.407ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57480
32692024-11-19T06:05:15.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57480 req_id = 2028df91-b511-4117-8936-da21558b02fa response_code = 200 uri = /v2p
32702024-11-19T06:05:15.462ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {9058fd45-e28a-4912-b28e-6057fa9506fb: {10.151.1.175: {2a7d89ac-69ee-4c06-b33c-868a39aa5892}, 10.151.1.176: {2a7d89ac-69ee-4c06-b33c-868a39aa5892}}} }
32712024-11-19T06:05:15.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51095 req_id = 5f293b1b-1c74-4e61-9165-180a2d3722d8 response_code = 204 uri = /eip-gateways
32722024-11-19T06:05:15.472ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {9058fd45-e28a-4912-b28e-6057fa9506fb: {10.151.1.176: {2a7d89ac-69ee-4c06-b33c-868a39aa5892}, 10.151.1.175: {2a7d89ac-69ee-4c06-b33c-868a39aa5892}}} }
32732024-11-19T06:05:15.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62897 req_id = 2c33363b-7012-477d-b0b4-881f3ba87228 response_code = 204 uri = /eip-gateways
32742024-11-19T06:05:15.488ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61450
32752024-11-19T06:05:15.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53109
32762024-11-19T06:05:15.511ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32772024-11-19T06:05:15.569ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32782024-11-19T06:05:15.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136765 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53109 req_id = a79896d0-2ac0-4186-956e-74e4ea5a501f response_code = 204 uri = /switch-ports
32792024-11-19T06:05:15.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53109 req_id = 2875e58e-5575-41b1-8fdd-979cb7b6cc42 response_code = 200 uri = /network-bootstore-config
32802024-11-19T06:05:15.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 573 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51095 req_id = aea3af5a-ccd7-492f-941c-2141267366c6 response_code = 204 uri = /vpc-routes
32812024-11-19T06:05:15.671ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836") failed: Property not found. retry in 1.296704105s file = illumos-utils/src/svc.rs:36 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836 zone = oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836
32822024-11-19T06:05:15.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53262
32832024-11-19T06:05:15.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53262 req_id = a875c874-5282-4ff2-acbf-769644c31227 response_code = 200 uri = /v2p
32842024-11-19T06:05:15.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57650
32852024-11-19T06:05:15.710ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32862024-11-19T06:05:15.747ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32872024-11-19T06:05:15.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99349 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57650 req_id = beaceee4-2252-4c1b-9501-b222a0ef1c0a response_code = 204 uri = /switch-ports
32882024-11-19T06:05:15.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53569
32892024-11-19T06:05:15.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58166
32902024-11-19T06:05:15.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57650 req_id = 962a2e47-2122-484b-bae7-97aaf901d572 response_code = 200 uri = /network-bootstore-config
32912024-11-19T06:05:15.810ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: c7b413d6-3c47-4a1e-8edb-6730be993801, version: 3 } old_vers = RouterVersion { router_id: c7b413d6-3c47-4a1e-8edb-6730be993801, version: 3 } subnet = RouterId { vni: Vni(11321002), kind: System }
32922024-11-19T06:05:15.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 491 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62897 req_id = 3ef86295-6fe4-4151-b456-517faba50487 response_code = 204 uri = /vpc-routes
32932024-11-19T06:05:15.811ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32942024-11-19T06:05:15.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6545 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58166 req_id = de20758c-aefe-47e4-9475-6ed5977e38a7 response_code = 200 uri = /v2p
32952024-11-19T06:05:15.852ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32962024-11-19T06:05:15.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103246 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53569 req_id = 11777e0a-e428-40e9-a5e1-9f62e37b3d07 response_code = 204 uri = /switch-ports
32972024-11-19T06:05:15.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53569 req_id = 0186fdaf-2366-48b4-8f9e-b1fecbddd2e5 response_code = 200 uri = /network-bootstore-config
32982024-11-19T06:05:17.001ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836 file = sled-agent/src/instance.rs:1787 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836
32992024-11-19T06:05:17.011ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836
33002024-11-19T06:05:17.046ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836
33012024-11-19T06:05:17.185ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836
33022024-11-19T06:05:17.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1699273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61450 req_id = 42bfced5-6c83-4f41-9732-5d3e7e7f3a7e response_code = 200 uri = /vmms/6cf5bcc9-ddb7-474f-89b4-c76b970bc836/state
33032024-11-19T06:05:17.188ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1231 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33042024-11-19T06:05:17.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1815640 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51017 req_id = 7a5962df-204b-4457-b6b5-4b7fe874b7ab response_code = 200 uri = /vmms/6cf5bcc9-ddb7-474f-89b4-c76b970bc836/state
33052024-11-19T06:05:17.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1948395 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60408 req_id = 3ac5e1c3-2785-4d7a-8fe9-2c62e28d68a4 response_code = 200 uri = /vmms/6cf5bcc9-ddb7-474f-89b4-c76b970bc836/state
33062024-11-19T06:05:17.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7629233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42257 req_id = 70b37bab-d96e-46aa-be53-3a40f56a4da8 response_code = 204 uri = /eip-gateways
33072024-11-19T06:05:17.188ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-19T06:05:17.188423305Z } file = sled-agent/src/instance.rs:780 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836
33082024-11-19T06:05:17.188ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-19T06:05:17.188423305Z } propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836
33092024-11-19T06:05:17.188ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-19T06:05:17.188423305Z }, migration_in: None, migration_out: None }
33102024-11-19T06:05:17.209ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-19T06:05:17.209831547Z } file = sled-agent/src/instance.rs:780 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836
33112024-11-19T06:05:17.209ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-19T06:05:17.209831547Z } propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836
33122024-11-19T06:05:17.209ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-19T06:05:17.209831547Z }, migration_in: None, migration_out: None }
33132024-11-19T06:05:17.275ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: c7b413d6-3c47-4a1e-8edb-6730be993801, version: 3 } old_vers = RouterVersion { router_id: c7b413d6-3c47-4a1e-8edb-6730be993801, version: 3 } subnet = RouterId { vni: Vni(11321002), kind: System }
33142024-11-19T06:05:17.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 333 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42257 req_id = 8e39aa76-219e-4dea-8cc4-fe8124ecb52e response_code = 204 uri = /vpc-routes
33152024-11-19T06:05:17.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52192
33162024-11-19T06:05:17.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52192 req_id = 23813002-fd20-4e60-b88b-ec7b4c4c237c response_code = 200 uri = /vpc-routes
33172024-11-19T06:05:17.411ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {9058fd45-e28a-4912-b28e-6057fa9506fb: {10.151.1.175: {2a7d89ac-69ee-4c06-b33c-868a39aa5892}, 10.151.1.176: {2a7d89ac-69ee-4c06-b33c-868a39aa5892}}} }
33182024-11-19T06:05:17.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52192 req_id = f35e87ba-4635-4837-969c-7150ceb566df response_code = 204 uri = /eip-gateways
33192024-11-19T06:05:17.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52192 req_id = 54ae6104-7d39-4902-86d8-dfd13615a35d response_code = 204 uri = /vpc-routes
33202024-11-19T06:05:23.577ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33212024-11-19T06:05:23.578ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33222024-11-19T06:05:23.578ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33232024-11-19T06:05:23.579ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33242024-11-19T06:05:23.580ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33252024-11-19T06:05:23.580ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33262024-11-19T06:05:23.581ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33272024-11-19T06:05:23.581ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33282024-11-19T06:05:23.582ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33292024-11-19T06:05:23.582ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33302024-11-19T06:05:23.583ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33312024-11-19T06:05:23.584ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33322024-11-19T06:05:23.584ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33332024-11-19T06:05:23.586ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33342024-11-19T06:05:23.586ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33352024-11-19T06:05:23.587ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33362024-11-19T06:05:23.588ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33372024-11-19T06:05:23.589ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33382024-11-19T06:05:26.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62105
33392024-11-19T06:05:26.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 507 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62105 req_id = 277d2417-5ee0-4f55-be63-549e6710819f response_code = 200 uri = /vmms/6cf5bcc9-ddb7-474f-89b4-c76b970bc836/state
33402024-11-19T06:05:26.931ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-19T06:05:26.931245154Z } file = sled-agent/src/instance.rs:780 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836
33412024-11-19T06:05:26.931ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-19T06:05:26.931245154Z } propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836
33422024-11-19T06:05:26.931ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-19T06:05:26.931245154Z }, migration_in: None, migration_out: None }
33432024-11-19T06:05:26.939ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-19T06:05:26.939963544Z } file = sled-agent/src/instance.rs:780 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836
33442024-11-19T06:05:26.940ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-19T06:05:26.939963544Z } propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836
33452024-11-19T06:05:26.940ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836
33462024-11-19T06:05:26.940ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
33472024-11-19T06:05:26.940ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
33482024-11-19T06:05:26.940ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/309add57-857d-42cd-8f12-8351d275a791/debug/bundle/zone", "/pool/int/e96bca9b-11cd-4c01-9e26-77ae8318b28c/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/8f726703-f78a-4246-88d2-b12195677e7c/crypt/debug", "/pool/ext/d74ec2ce-1ac1-44f2-beaf-00cf9c1cda15/crypt/debug", "/pool/ext/35a1f44b-de46-41ee-ad1e-96313ecc15b9/crypt/debug", "/pool/ext/c5fdd794-3bc8-49cb-89e3-b36cc4eb9892/crypt/debug", "/pool/ext/b94b817f-675d-49a5-b1c9-b8c4fb8b401d/crypt/debug", "/pool/ext/5c871af8-68dd-4136-bfd3-234cd1e72e1e/crypt/debug", "/pool/ext/2d68dcb6-83b9-430c-b8d8-fa955e9efd1b/crypt/debug", "/pool/ext/b495ac81-0263-41cd-8fb6-3fe9f9a0bfc9/crypt/debug", "/pool/ext/685f3f58-b5f9-4e42-8994-bdac247f87cd/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836
33492024-11-19T06:05:27.629ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836", bundle_id: 7a624c3d-e4f0-4c3b-bc4e-7b766447de9b }, time_created: 2024-11-19T06:05:26.941360119Z, version: 0, cause: TerminatedInstance }
33502024-11-19T06:05:27.629ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_6cf5bcc9-ddb7-474f-89b4-c76b970bc836 file = sled-agent/src/instance.rs:1032 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836
33512024-11-19T06:05:29.390ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836
33522024-11-19T06:05:29.408ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(11321002), kind: System }
33532024-11-19T06:05:29.408ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(11321002), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
33542024-11-19T06:05:29.409ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-19T06:05:29.409261935Z }, migration_in: None, migration_out: None }
33552024-11-19T06:05:29.439ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-19T06:05:29.409261935Z }, migration_in: None, migration_out: None }
33562024-11-19T06:05:29.442ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = d2ae3154-15d2-4272-ab40-624b3239c2e7 propolis_id = 6cf5bcc9-ddb7-474f-89b4-c76b970bc836
33572024-11-19T06:05:29.925ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45310
33582024-11-19T06:05:29.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45310 req_id = 0b84fa54-833d-4aa6-bdf1-2cd0f0528299 response_code = 200 uri = /vpc-routes
33592024-11-19T06:05:29.966ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
33602024-11-19T06:05:29.966ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1231 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33612024-11-19T06:05:29.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45310 req_id = 341b354f-a27e-4fdc-b6f3-ffe178fcdc23 response_code = 204 uri = /eip-gateways
33622024-11-19T06:05:29.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45310 req_id = 4f370f87-d31b-45f4-aa48-d095d186f02b response_code = 204 uri = /vpc-routes
33632024-11-19T06:05:30.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55256
33642024-11-19T06:05:30.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55256 req_id = 191b64a5-e32a-4398-8888-c7f7d1e647d1 response_code = 200 uri = /v2p
33652024-11-19T06:05:30.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38441
33662024-11-19T06:05:30.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38441 req_id = eed50375-b387-4aae-a421-edb1421c085c response_code = 200 uri = /v2p
33672024-11-19T06:05:30.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33395
33682024-11-19T06:05:30.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33395 req_id = 270edafd-12eb-4638-9eab-5f6f5cf47619 response_code = 200 uri = /vpc-routes
33692024-11-19T06:05:30.335ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
33702024-11-19T06:05:30.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33395 req_id = 636201e0-6111-42a7-bf25-89f573f9d31f response_code = 204 uri = /eip-gateways
33712024-11-19T06:05:30.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33395 req_id = 9d479e31-1599-41d6-8fcb-b421608e71ef response_code = 204 uri = /vpc-routes
33722024-11-19T06:05:31.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44359
33732024-11-19T06:05:31.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44359 req_id = b347fb8d-d67d-4917-8ad5-99e6a5ef08cc response_code = 200 uri = /vpc-routes
33742024-11-19T06:05:31.141ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 176942d8-6f67-414d-8390-55e992dfe909 values = ExternalIpGatewayMap { mappings: {} }
33752024-11-19T06:05:31.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44359 req_id = ae98f236-5440-4853-b1d2-51eb1a411176 response_code = 204 uri = /eip-gateways
33762024-11-19T06:05:31.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44359 req_id = c6c371cd-cfd4-4b23-b00e-da186007c5da response_code = 204 uri = /vpc-routes
33772024-11-19T06:05:33.581ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33782024-11-19T06:05:33.582ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33792024-11-19T06:05:33.582ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33802024-11-19T06:05:33.583ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33812024-11-19T06:05:33.584ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33822024-11-19T06:05:33.585ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33832024-11-19T06:05:33.585ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33842024-11-19T06:05:33.586ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33852024-11-19T06:05:33.586ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33862024-11-19T06:05:33.587ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33872024-11-19T06:05:33.587ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33882024-11-19T06:05:33.588ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33892024-11-19T06:05:33.589ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33902024-11-19T06:05:33.590ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33912024-11-19T06:05:33.590ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33922024-11-19T06:05:33.592ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33932024-11-19T06:05:33.592ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909
33942024-11-19T06:05:33.593ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 176942d8-6f67-414d-8390-55e992dfe909