Max level shown:
1 [ Nov 14 16:51:52 Enabled. ]
2 [ Nov 14 16:51:52 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 14 16:51:52 Method "start" exited with status 0. ]
4 [ Nov 14 16:51:52 Rereading configuration. ]
5 [ Nov 14 16:51:52 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-14T16:51:52.656ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-14T16:51:52.656ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-14T16:51:52.707ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-14T16:51:52.707ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-14T16:51:52.823ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-14T16:51:52.832ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-14T16:51:52.839ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-14T16:51:53.440ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-11-14T16:51:53.578ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-14T16:51:53.578ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-14T16:51:53.578ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-14T16:51:53.578ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-14T16:51:53.578ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-11-14T16:51:53.578ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-11-14T16:51:53.581ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-14T16:51:53.581ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-14T16:51:53.581ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-14T16:51:53.581ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-14T16:51:53.581ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-14T16:51:53.581ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-14T16:51:53.582ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-11-14T16:51:53.582ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-14T16:51:53.582ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-14T16:51:53.592ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-14T16:51:53.592ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = dece35c4-89fd-420c-8f29-55cf8d3ec653 (zpool)
322024-11-14T16:51:53.690ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: dece35c4-89fd-420c-8f29-55cf8d3ec653 (zpool), kind: Internal }
332024-11-14T16:51:54.163ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-11-14T16:51:54.163ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-14T16:51:54.163ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-14T16:51:54.164ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-14T16:51:54.164ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-11-14T16:51:54.164ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-14T16:51:54.164ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-14T16:51:54.172ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-14T16:51:54.172ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 0f4f4da0-c98a-4c67-b269-a009de7cb287 (zpool)
422024-11-14T16:51:54.262ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 0f4f4da0-c98a-4c67-b269-a009de7cb287 (zpool), kind: Internal }
432024-11-14T16:51:54.736ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-14T16:51:54.736ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dece35c4-89fd-420c-8f29-55cf8d3ec653 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0f4f4da0-c98a-4c67-b269-a009de7cb287 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-14T16:51:54.736ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
462024-11-14T16:51:54.736ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
472024-11-14T16:51:54.736ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
482024-11-14T16:51:54.736ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
492024-11-14T16:51:54.736ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-14T16:51:54.736ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dece35c4-89fd-420c-8f29-55cf8d3ec653 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0f4f4da0-c98a-4c67-b269-a009de7cb287 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-11-14T16:51:54.736ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
522024-11-14T16:51:54.736ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
532024-11-14T16:51:54.736ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
542024-11-14T16:51:54.736ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552024-11-14T16:51:54.736ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-14T16:51:54.736ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dece35c4-89fd-420c-8f29-55cf8d3ec653 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0f4f4da0-c98a-4c67-b269-a009de7cb287 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-11-14T16:51:54.736ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
582024-11-14T16:51:54.736ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-11-14T16:51:54.736ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-11-14T16:51:54.736ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-11-14T16:51:54.736ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-14T16:51:54.736ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
632024-11-14T16:51:54.736ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
642024-11-14T16:51:54.736ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dece35c4-89fd-420c-8f29-55cf8d3ec653 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0f4f4da0-c98a-4c67-b269-a009de7cb287 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
652024-11-14T16:51:54.736ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-11-14T16:51:54.736ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-11-14T16:51:54.736ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-14T16:51:54.736ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dece35c4-89fd-420c-8f29-55cf8d3ec653 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0f4f4da0-c98a-4c67-b269-a009de7cb287 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-11-14T16:51:54.736ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-11-14T16:51:54.736ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-11-14T16:51:54.736ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
722024-11-14T16:51:54.736ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-11-14T16:51:54.736ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-14T16:51:54.736ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dece35c4-89fd-420c-8f29-55cf8d3ec653 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0f4f4da0-c98a-4c67-b269-a009de7cb287 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-11-14T16:51:54.736ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-11-14T16:51:54.736ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-11-14T16:51:54.736ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-11-14T16:51:54.736ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-11-14T16:51:54.736ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-11-14T16:51:54.736ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dece35c4-89fd-420c-8f29-55cf8d3ec653 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0f4f4da0-c98a-4c67-b269-a009de7cb287 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-11-14T16:51:54.736ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822024-11-14T16:51:54.736ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
832024-11-14T16:51:54.736ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
842024-11-14T16:51:54.736ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-11-14T16:51:54.736ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-11-14T16:51:54.736ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dece35c4-89fd-420c-8f29-55cf8d3ec653 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0f4f4da0-c98a-4c67-b269-a009de7cb287 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
872024-11-14T16:51:54.736ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
882024-11-14T16:51:54.736ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
892024-11-14T16:51:54.736ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
902024-11-14T16:51:54.736ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
912024-11-14T16:51:54.736ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-11-14T16:51:54.736ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
932024-11-14T16:51:54.736ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-11-14T16:51:54.736ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dece35c4-89fd-420c-8f29-55cf8d3ec653 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0f4f4da0-c98a-4c67-b269-a009de7cb287 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-11-14T16:51:54.736ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-11-14T16:51:54.736ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-11-14T16:51:54.736ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-11-14T16:51:54.736ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-11-14T16:51:54.736ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dece35c4-89fd-420c-8f29-55cf8d3ec653 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0f4f4da0-c98a-4c67-b269-a009de7cb287 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-11-14T16:51:54.736ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-11-14T16:51:54.736ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-11-14T16:51:54.736ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1032024-11-14T16:51:54.736ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-11-14T16:51:54.736ZINFOSledAgent (bootstore): No ledger in /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-11-14T16:51:54.736ZINFOSledAgent (bootstore): No ledger in /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-11-14T16:51:54.736ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-11-14T16:51:54.736ZINFOSledAgent (bootstore): No ledger in /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-11-14T16:51:54.736ZINFOSledAgent (bootstore): No ledger in /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-11-14T16:51:54.736ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-11-14T16:51:54.736ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-14T16:51:54.736ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-14T16:51:54.748ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1132024-11-14T16:51:54.748ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 2238, tv_nsec: 33945429 } time_to_next_cleanup = 599.999927889s
1142024-11-14T16:51:54.748ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1152024-11-14T16:51:54.748ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-11-14T16:51:54.748ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-11-14T16:51:54.748ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-11-14T16:51:54.751ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-11-14T16:51:54.753ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-11-14T16:51:54.753ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1200
1212024-11-14T16:51:54.753ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-14T16:51:54.753ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-11-14T16:51:54.753ZINFOSledAgent (RSS): No ledger in /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-11-14T16:51:54.753ZINFOSledAgent (RSS): No ledger in /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-11-14T16:51:54.753ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1263
1262024-11-14T16:51:54.754ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1272024-11-14T16:51:54.754ZINFOSledAgent (RSS): No ledger in /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-11-14T16:51:54.754ZINFOSledAgent (RSS): No ledger in /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-11-14T16:51:54.754ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1305
1302024-11-14T16:51:54.754ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-14T16:51:54.754ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-14T16:51:54.754ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1332024-11-14T16:51:54.754ZINFOSledAgent (RSS): Writing ledger to /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-11-14T16:51:54.754ZINFOSledAgent (RSS): Writing ledger to /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-11-14T16:51:54.754ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: bea93e92-909d-49e0-be82-54bba0eec36c, sleds: { [fdb0:18c0:4d0d:9fb2::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: f70fbf74-7489-439f-8ec3-e6e8473a8b43 (sled), rack_id: bea93e92-909d-49e0-be82-54bba0eec36c, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-11-14T16:51:54.754ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1339
1372024-11-14T16:51:54.754ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1382024-11-14T16:51:54.754ZINFOSledAgent (bootstore): Writing ledger to /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1392024-11-14T16:51:54.754ZINFOSledAgent (bootstore): Writing ledger to /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1402024-11-14T16:51:54.754ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1412024-11-14T16:51:54.755ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: f70fbf74-7489-439f-8ec3-e6e8473a8b43 (sled), rack_id: bea93e92-909d-49e0-be82-54bba0eec36c, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1422024-11-14T16:51:54.755ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1432024-11-14T16:51:54.755ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1442024-11-14T16:51:54.760ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1452024-11-14T16:51:54.765ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-11-14T16:51:54.766ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-11-14T16:51:54.770ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1482024-11-14T16:51:54.770ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1492024-11-14T16:51:54.770ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:58112
1502024-11-14T16:51:54.770ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: f70fbf74-7489-439f-8ec3-e6e8473a8b43 (sled), rack_id: bea93e92-909d-49e0-be82-54bba0eec36c, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1512024-11-14T16:51:54.770ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1522024-11-14T16:51:54.770ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532024-11-14T16:51:54.770ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542024-11-14T16:51:54.770ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1552024-11-14T16:51:54.770ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1562024-11-14T16:51:54.770ZINFOSledAgent (StorageManager): No ledger in /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572024-11-14T16:51:54.770ZINFOSledAgent (StorageManager): No ledger in /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1582024-11-14T16:51:54.770ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1592024-11-14T16:51:54.770ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1602024-11-14T16:51:54.770ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1612024-11-14T16:51:54.770ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1622024-11-14T16:51:54.770ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1632024-11-14T16:51:54.770ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1642024-11-14T16:51:54.785ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1652024-11-14T16:51:54.805ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1662024-11-14T16:51:54.822ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1672024-11-14T16:51:54.831ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:408 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
1682024-11-14T16:51:54.831ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1692024-11-14T16:51:54.831ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:420 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
1702024-11-14T16:51:54.831ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1712024-11-14T16:51:54.834ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 61.904533ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7f46fde2-9fdf-43f3-818d-66310748749d", "content-length": "124", "date": "Thu, 14 Nov 2024 16:51:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7f46fde2-9fdf-43f3-818d-66310748749d" } file = clients/ddm-admin-client/src/lib.rs:177
1722024-11-14T16:51:54.845ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_dece35c4-89fd-420c-8f29-55cf8d3ec653/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1732024-11-14T16:51:54.869ZINFOSledAgent: successfully created encrypted zvol: name="oxi_dece35c4-89fd-420c-8f29-55cf8d3ec653/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1742024-11-14T16:51:54.869ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_dece35c4-89fd-420c-8f29-55cf8d3ec653/swap" file = sled-agent/src/swap_device.rs:96
1752024-11-14T16:51:54.874ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:435 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
1762024-11-14T16:51:54.874ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1772024-11-14T16:51:54.874ZINFOSledAgent (BackingFs): Ensuring dataset oxi_dece35c4-89fd-420c-8f29-55cf8d3ec653/backing/fmd file = sled-agent/src/backing_fs.rs:138
1782024-11-14T16:51:54.896ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1792024-11-14T16:51:54.897ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 116.839506ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8002bf31-7511-45a7-b5f1-a996d9cd6a98", "content-length": "124", "date": "Thu, 14 Nov 2024 16:51:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8002bf31-7511-45a7-b5f1-a996d9cd6a98" } file = clients/ddm-admin-client/src/lib.rs:177
1802024-11-14T16:51:54.960ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1812024-11-14T16:51:55.015ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-11-14T16:51:55.015ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 161.240396ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7650cf26-b3b4-4a11-8f69-d667d20683b6", "content-length": "124", "date": "Thu, 14 Nov 2024 16:51:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7650cf26-b3b4-4a11-8f69-d667d20683b6" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-11-14T16:51:55.178ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1842024-11-14T16:51:55.178ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 157.791198ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "aea676dd-1fac-4a87-9452-c9f302dc85f5", "content-length": "124", "date": "Thu, 14 Nov 2024 16:51:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "aea676dd-1fac-4a87-9452-c9f302dc85f5" } file = clients/ddm-admin-client/src/lib.rs:177
1852024-11-14T16:51:55.179ZINFOSledAgent (BackingFs): Mounting oxi_dece35c4-89fd-420c-8f29-55cf8d3ec653/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1862024-11-14T16:51:55.192ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1872024-11-14T16:51:55.192ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1882024-11-14T16:51:55.192ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1892024-11-14T16:51:55.192ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1902024-11-14T16:51:55.337ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-11-14T16:51:55.338ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 262.639817ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f9d34256-9073-4bf5-9ec2-0ba3644d16fc", "content-length": "124", "date": "Thu, 14 Nov 2024 16:51:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f9d34256-9073-4bf5-9ec2-0ba3644d16fc" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-11-14T16:51:55.602ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-11-14T16:51:55.602ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 130.631785ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b2796ffd-eea6-480d-acb0-559281489855", "content-length": "124", "date": "Thu, 14 Nov 2024 16:51:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b2796ffd-eea6-480d-acb0-559281489855" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-11-14T16:51:55.733ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1952024-11-14T16:51:55.734ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 165.779758ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "23f2c5c3-29b8-40bb-aded-17b832f04ee2", "content-length": "124", "date": "Thu, 14 Nov 2024 16:51:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "23f2c5c3-29b8-40bb-aded-17b832f04ee2" } file = clients/ddm-admin-client/src/lib.rs:177
1962024-11-14T16:51:55.901ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1972024-11-14T16:51:55.933ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
1982024-11-14T16:51:55.942ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:60350 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
1992024-11-14T16:51:55.942ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
2002024-11-14T16:51:55.942ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:60350 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
2012024-11-14T16:51:55.943ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 252.586786ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
2022024-11-14T16:51:55.944ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
2032024-11-14T16:51:55.944ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
2042024-11-14T16:51:55.944ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2052024-11-14T16:51:55.944ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2062024-11-14T16:51:56.198ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 420.174739ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
2072024-11-14T16:51:56.619ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.379153233s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
2082024-11-14T16:51:58.001ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.898461931s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
2092024-11-14T16:51:58.565ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2102024-11-14T16:51:58.565ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2112024-11-14T16:51:58.565ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2122024-11-14T16:51:58.565ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2132024-11-14T16:51:58.565ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2142024-11-14T16:51:58.565ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2152024-11-14T16:51:58.567ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2162024-11-14T16:51:58.569ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2172024-11-14T16:51:58.569ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='96e8c35c-9335-4348-babf-c56b7d06c593'/> <propval type="astring" name="rack_id" value='bea93e92-909d-49e0-be82-54bba0eec36c'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe8a:1eb9'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='bea93e92-909d-49e0-be82-54bba0eec36c'/> <propval type="astring" name="sled_id" value='f70fbf74-7489-439f-8ec3-e6e8473a8b43'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='f70fbf74-7489-439f-8ec3-e6e8473a8b43'/> <propval type="astring" name="rack_uuid" value='bea93e92-909d-49e0-be82-54bba0eec36c'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='f70fbf74-7489-439f-8ec3-e6e8473a8b43'/> <propval type="astring" name="rack_uuid" value='bea93e92-909d-49e0-be82-54bba0eec36c'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2182024-11-14T16:51:58.569ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2192024-11-14T16:51:58.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 73.399078ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-11-14T16:51:59.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 94.922405ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-11-14T16:51:59.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 117.270338ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-11-14T16:51:59.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 514.110723ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-11-14T16:51:59.900ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.735321553s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
2242024-11-14T16:52:00.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 849.06192ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-11-14T16:52:01.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.124639486s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-14T16:52:02.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 609.037787ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-11-14T16:52:02.637ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 9.699468139s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
2282024-11-14T16:52:03.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 698.56993ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-11-14T16:52:03.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.293974805s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2302024-11-14T16:52:05.649ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/f70fbf74-7489-439f-8ec3-e6e8473a8b43) file = sled-agent/src/nexus.rs:527 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
2312024-11-14T16:52:05.679ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2322024-11-14T16:52:05.679ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
2332024-11-14T16:52:05.680ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2342024-11-14T16:52:05.680ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2352024-11-14T16:52:05.680ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2362024-11-14T16:52:05.680ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2372024-11-14T16:52:05.680ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2382024-11-14T16:52:05.680ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2392024-11-14T16:52:05.681ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2402024-11-14T16:52:05.681ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2412024-11-14T16:52:05.681ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:58112
2422024-11-14T16:52:05.870ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2432024-11-14T16:52:05.870ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2442024-11-14T16:52:05.871ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2452024-11-14T16:52:05.871ZINFOSledAgent (RSS): No ledger in /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2462024-11-14T16:52:05.871ZINFOSledAgent (RSS): No ledger in /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2472024-11-14T16:52:05.871ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2482024-11-14T16:52:05.871ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2492024-11-14T16:52:05.871ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2502024-11-14T16:52:05.871ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2512024-11-14T16:52:05.875ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2522024-11-14T16:52:05.875ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2532024-11-14T16:52:05.875ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2542024-11-14T16:52:06.099ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13867837908407612504 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
2552024-11-14T16:52:06.099ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 234981320897751439 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
2562024-11-14T16:52:06.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62520
2572024-11-14T16:52:06.127ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2582024-11-14T16:52:06.127ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2592024-11-14T16:52:06.127ZINFOSledAgent (ServiceManager): No ledger in /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/omicron-zones.json file = common/src/ledger.rs:188
2602024-11-14T16:52:06.127ZINFOSledAgent (ServiceManager): No ledger in /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/omicron-zones.json file = common/src/ledger.rs:188
2612024-11-14T16:52:06.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62520 req_id = cd2c7a17-1ffc-4e4e-8dfb-b209d5c91674 response_code = 200 uri = /inventory
2622024-11-14T16:52:06.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33702
2632024-11-14T16:52:06.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33702 req_id = 269f4366-70ab-431a-b463-513508f8e8fe response_code = 200 uri = /sled-role
2642024-11-14T16:52:06.157ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2652024-11-14T16:52:06.157ZINFOSledAgent (RSS): Writing ledger to /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2662024-11-14T16:52:06.158ZINFOSledAgent (RSS): Writing ledger to /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2672024-11-14T16:52:06.158ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:980
2682024-11-14T16:52:06.189ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 43545632-b37d-4aa2-95f7-91eb5ca5aff7, pool_id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: c5cb3482-b219-469a-a243-05a64e083df2, pool_id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 29c279ba-886a-4433-8672-3b8a544c0bbe, pool_id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 70aa5c2d-9bad-47ff-acfb-83d4bfb29b04, pool_id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: ba96eb03-5147-4743-85db-e4273e59273a, pool_id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 5938a1c7-bf34-422f-992a-a09d13a3bd1a, pool_id: 8fbbea6c-76df-4af7-a25f-3e2c165ad855 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: d5ff73ee-f35b-4f10-be69-f954e23f8ec9, pool_id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: fdab72ab-acfb-44b5-83c0-2887bf6cc5e9, pool_id: f3390b76-1a47-437d-b003-6296b24d9932 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 51f22465-3bd8-4e3d-8600-6d5643d69e9c, pool_id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool) }] } file = sled-agent/src/rack_setup/service.rs:382 sled_address = [fd00:1122:3344:101::1]:12345
2692024-11-14T16:52:06.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35913
2702024-11-14T16:52:06.190ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:884 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
2712024-11-14T16:52:06.190ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 43545632-b37d-4aa2-95f7-91eb5ca5aff7, pool_id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: c5cb3482-b219-469a-a243-05a64e083df2, pool_id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 29c279ba-886a-4433-8672-3b8a544c0bbe, pool_id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 70aa5c2d-9bad-47ff-acfb-83d4bfb29b04, pool_id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: ba96eb03-5147-4743-85db-e4273e59273a, pool_id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 5938a1c7-bf34-422f-992a-a09d13a3bd1a, pool_id: 8fbbea6c-76df-4af7-a25f-3e2c165ad855 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: d5ff73ee-f35b-4f10-be69-f954e23f8ec9, pool_id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: fdab72ab-acfb-44b5-83c0-2887bf6cc5e9, pool_id: f3390b76-1a47-437d-b003-6296b24d9932 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 51f22465-3bd8-4e3d-8600-6d5643d69e9c, pool_id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2722024-11-14T16:52:06.190ZINFOSledAgent (StorageManager): No ledger in /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2732024-11-14T16:52:06.190ZINFOSledAgent (StorageManager): No ledger in /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2742024-11-14T16:52:06.190ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2752024-11-14T16:52:06.190ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2762024-11-14T16:52:06.190ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2772024-11-14T16:52:06.190ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2782024-11-14T16:52:06.190ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2792024-11-14T16:52:06.346ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2802024-11-14T16:52:06.347ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool)
2812024-11-14T16:52:06.563ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
2822024-11-14T16:52:06.657ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }
2832024-11-14T16:52:06.663ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2842024-11-14T16:52:06.664ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2852024-11-14T16:52:06.664ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2862024-11-14T16:52:06.664ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2872024-11-14T16:52:06.664ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2882024-11-14T16:52:06.664ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2892024-11-14T16:52:06.664ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2902024-11-14T16:52:06.681ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43) file = sled-agent/src/probe_manager.rs:231 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
2912024-11-14T16:52:06.697ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2922024-11-14T16:52:06.704ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_da94b0fc-e114-4d62-8eee-1f3b839145a7/crypt/zone file = sled-storage/src/dataset.rs:303
2932024-11-14T16:52:06.866ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_da94b0fc-e114-4d62-8eee-1f3b839145a7 file = sled-storage/src/dataset.rs:389
2942024-11-14T16:52:06.873ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2952024-11-14T16:52:06.873ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2962024-11-14T16:52:06.873ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2972024-11-14T16:52:06.873ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2982024-11-14T16:52:06.873ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2992024-11-14T16:52:06.883ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
3002024-11-14T16:52:06.883ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 0e37ddab-daec-4c38-a903-78b351e48433 (zpool)
3012024-11-14T16:52:06.974ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }
3022024-11-14T16:52:06.982ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
3032024-11-14T16:52:06.982ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
3042024-11-14T16:52:06.982ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
3052024-11-14T16:52:06.982ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
3062024-11-14T16:52:06.982ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3072024-11-14T16:52:06.982ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3082024-11-14T16:52:06.982ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3092024-11-14T16:52:07.017ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3102024-11-14T16:52:07.026ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_0e37ddab-daec-4c38-a903-78b351e48433/crypt/zone file = sled-storage/src/dataset.rs:303
3112024-11-14T16:52:07.206ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_0e37ddab-daec-4c38-a903-78b351e48433 file = sled-storage/src/dataset.rs:389
3122024-11-14T16:52:07.214ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3132024-11-14T16:52:07.214ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3142024-11-14T16:52:07.214ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3152024-11-14T16:52:07.214ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3162024-11-14T16:52:07.214ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3172024-11-14T16:52:07.224ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3182024-11-14T16:52:07.224ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool)
3192024-11-14T16:52:07.313ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }
3202024-11-14T16:52:07.321ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3212024-11-14T16:52:07.321ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3222024-11-14T16:52:07.321ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3232024-11-14T16:52:07.321ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3242024-11-14T16:52:07.321ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3252024-11-14T16:52:07.321ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3262024-11-14T16:52:07.321ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3272024-11-14T16:52:07.354ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3282024-11-14T16:52:07.361ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a47fbfc2-afec-46c8-bc5a-f6c02b232d2e/crypt/zone file = sled-storage/src/dataset.rs:303
3292024-11-14T16:52:07.526ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a47fbfc2-afec-46c8-bc5a-f6c02b232d2e file = sled-storage/src/dataset.rs:389
3302024-11-14T16:52:07.533ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3312024-11-14T16:52:07.533ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3322024-11-14T16:52:07.533ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3332024-11-14T16:52:07.533ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3342024-11-14T16:52:07.533ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3352024-11-14T16:52:07.543ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3362024-11-14T16:52:07.543ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool)
3372024-11-14T16:52:07.638ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }
3382024-11-14T16:52:07.646ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3392024-11-14T16:52:07.646ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3402024-11-14T16:52:07.646ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3412024-11-14T16:52:07.646ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3422024-11-14T16:52:07.646ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3432024-11-14T16:52:07.646ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3442024-11-14T16:52:07.646ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3452024-11-14T16:52:07.682ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3462024-11-14T16:52:07.685ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43) file = sled-agent/src/probe_manager.rs:231 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
3472024-11-14T16:52:07.690ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e573afbb-ee4c-4f2d-9d08-b65b7fca29cf/crypt/zone file = sled-storage/src/dataset.rs:303
3482024-11-14T16:52:07.858ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e573afbb-ee4c-4f2d-9d08-b65b7fca29cf file = sled-storage/src/dataset.rs:389
3492024-11-14T16:52:07.866ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3502024-11-14T16:52:07.866ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3512024-11-14T16:52:07.866ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3522024-11-14T16:52:07.866ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3532024-11-14T16:52:07.866ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3542024-11-14T16:52:07.876ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3552024-11-14T16:52:07.876ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool)
3562024-11-14T16:52:07.971ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }
3572024-11-14T16:52:07.979ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3582024-11-14T16:52:07.979ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3592024-11-14T16:52:07.979ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3602024-11-14T16:52:07.979ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3612024-11-14T16:52:07.979ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3622024-11-14T16:52:07.979ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3632024-11-14T16:52:07.979ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3642024-11-14T16:52:08.014ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3652024-11-14T16:52:08.023ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_63c85555-7e85-4f53-92b1-afc3cd212893/crypt/zone file = sled-storage/src/dataset.rs:303
3662024-11-14T16:52:08.202ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_63c85555-7e85-4f53-92b1-afc3cd212893 file = sled-storage/src/dataset.rs:389
3672024-11-14T16:52:08.211ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3682024-11-14T16:52:08.211ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3692024-11-14T16:52:08.211ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3702024-11-14T16:52:08.211ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3712024-11-14T16:52:08.211ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3722024-11-14T16:52:08.220ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3732024-11-14T16:52:08.220ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 8fbbea6c-76df-4af7-a25f-3e2c165ad855 (zpool)
3742024-11-14T16:52:08.317ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8fbbea6c-76df-4af7-a25f-3e2c165ad855 (zpool), kind: External }
3752024-11-14T16:52:08.325ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3762024-11-14T16:52:08.325ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3772024-11-14T16:52:08.325ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3782024-11-14T16:52:08.325ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3792024-11-14T16:52:08.325ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3802024-11-14T16:52:08.325ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3812024-11-14T16:52:08.325ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3822024-11-14T16:52:08.359ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3832024-11-14T16:52:08.368ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8fbbea6c-76df-4af7-a25f-3e2c165ad855/crypt/zone file = sled-storage/src/dataset.rs:303
3842024-11-14T16:52:08.550ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8fbbea6c-76df-4af7-a25f-3e2c165ad855 file = sled-storage/src/dataset.rs:389
3852024-11-14T16:52:08.559ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3862024-11-14T16:52:08.559ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3872024-11-14T16:52:08.559ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3882024-11-14T16:52:08.559ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3892024-11-14T16:52:08.559ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3902024-11-14T16:52:08.569ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3912024-11-14T16:52:08.569ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool)
3922024-11-14T16:52:08.672ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }
3932024-11-14T16:52:08.680ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3942024-11-14T16:52:08.680ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3952024-11-14T16:52:08.681ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3962024-11-14T16:52:08.681ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3972024-11-14T16:52:08.681ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3982024-11-14T16:52:08.681ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3992024-11-14T16:52:08.681ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4002024-11-14T16:52:08.688ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43) file = sled-agent/src/probe_manager.rs:231 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
4012024-11-14T16:52:08.718ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4022024-11-14T16:52:08.726ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ad871e3f-9a86-4a01-ac75-964bae58e4aa/crypt/zone file = sled-storage/src/dataset.rs:303
4032024-11-14T16:52:08.908ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ad871e3f-9a86-4a01-ac75-964bae58e4aa file = sled-storage/src/dataset.rs:389
4042024-11-14T16:52:08.916ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4052024-11-14T16:52:08.916ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4062024-11-14T16:52:08.916ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4072024-11-14T16:52:08.916ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4082024-11-14T16:52:08.916ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4092024-11-14T16:52:08.927ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4102024-11-14T16:52:08.927ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f3390b76-1a47-437d-b003-6296b24d9932 (zpool)
4112024-11-14T16:52:09.028ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f3390b76-1a47-437d-b003-6296b24d9932 (zpool), kind: External }
4122024-11-14T16:52:09.036ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4132024-11-14T16:52:09.036ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4142024-11-14T16:52:09.036ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4152024-11-14T16:52:09.036ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4162024-11-14T16:52:09.036ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4172024-11-14T16:52:09.036ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4182024-11-14T16:52:09.036ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4192024-11-14T16:52:09.071ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4202024-11-14T16:52:09.079ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f3390b76-1a47-437d-b003-6296b24d9932/crypt/zone file = sled-storage/src/dataset.rs:303
4212024-11-14T16:52:09.257ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f3390b76-1a47-437d-b003-6296b24d9932 file = sled-storage/src/dataset.rs:389
4222024-11-14T16:52:09.266ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4232024-11-14T16:52:09.266ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4242024-11-14T16:52:09.266ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4252024-11-14T16:52:09.266ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4262024-11-14T16:52:09.266ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4272024-11-14T16:52:09.275ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4282024-11-14T16:52:09.275ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool)
4292024-11-14T16:52:09.373ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool), kind: External }
4302024-11-14T16:52:09.382ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4312024-11-14T16:52:09.382ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4322024-11-14T16:52:09.382ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4332024-11-14T16:52:09.382ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4342024-11-14T16:52:09.382ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4352024-11-14T16:52:09.382ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4362024-11-14T16:52:09.382ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4372024-11-14T16:52:09.419ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4382024-11-14T16:52:09.426ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c/crypt/zone file = sled-storage/src/dataset.rs:303
4392024-11-14T16:52:09.603ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c file = sled-storage/src/dataset.rs:389
4402024-11-14T16:52:09.611ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4412024-11-14T16:52:09.611ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4422024-11-14T16:52:09.611ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4432024-11-14T16:52:09.611ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dece35c4-89fd-420c-8f29-55cf8d3ec653 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0f4f4da0-c98a-4c67-b269-a009de7cb287 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8fbbea6c-76df-4af7-a25f-3e2c165ad855 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f3390b76-1a47-437d-b003-6296b24d9932 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4442024-11-14T16:52:09.611ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4452024-11-14T16:52:09.611ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4462024-11-14T16:52:09.611ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4472024-11-14T16:52:09.612ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:888 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
4482024-11-14T16:52:09.612ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4492024-11-14T16:52:09.612ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:914 generation = Generation(1) sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
4502024-11-14T16:52:09.612ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:919 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
4512024-11-14T16:52:09.612ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:924 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
4522024-11-14T16:52:09.612ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
4532024-11-14T16:52:09.612ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:930 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
4542024-11-14T16:52:09.612ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4552024-11-14T16:52:09.612ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:935 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
4562024-11-14T16:52:09.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3422241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:35913 req_id = 951caee5-ae0a-4d46-b952-79091399e4be response_code = 200 uri = /omicron-physical-disks
4572024-11-14T16:52:09.644ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {00a0201f-ac94-494c-809d-d28badc9983a (dataset): DatasetConfig { id: 00a0201f-ac94-494c-809d-d28badc9983a (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 010ff1bb-83e6-45e8-9392-96bcfec29be4 (dataset): DatasetConfig { id: 010ff1bb-83e6-45e8-9392-96bcfec29be4 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 04259c8d-b11f-4800-8b1e-e01f1200229b (dataset): DatasetConfig { id: 04259c8d-b11f-4800-8b1e-e01f1200229b (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 054d0fce-d2ae-466d-879f-12f52e25bc09 (dataset): DatasetConfig { id: 054d0fce-d2ae-466d-879f-12f52e25bc09 (dataset), name: DatasetName { pool_name: ZpoolName { id: f3390b76-1a47-437d-b003-6296b24d9932 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b848153-e975-4186-b84a-4a096ae270ca (dataset): DatasetConfig { id: 0b848153-e975-4186-b84a-4a096ae270ca (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 19f5da16-14dc-4f19-b8cc-0b9d4311f273 (dataset): DatasetConfig { id: 19f5da16-14dc-4f19-b8cc-0b9d4311f273 (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1ebac74e-513e-45ba-9d6a-f74b998fe750 (dataset): DatasetConfig { id: 1ebac74e-513e-45ba-9d6a-f74b998fe750 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1efa081c-6c86-4d82-8680-7a79914ee8e9 (dataset): DatasetConfig { id: 1efa081c-6c86-4d82-8680-7a79914ee8e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8fbbea6c-76df-4af7-a25f-3e2c165ad855 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1f33bdfa-b0d9-478b-af5c-4802efe1c89c (dataset): DatasetConfig { id: 1f33bdfa-b0d9-478b-af5c-4802efe1c89c (dataset), name: DatasetName { pool_name: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1fa5b32d-2d9d-4f7e-87e5-4e4c65f38b0b (dataset): DatasetConfig { id: 1fa5b32d-2d9d-4f7e-87e5-4e4c65f38b0b (dataset), name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37362eef-c1b6-4314-9d44-575caa660704 (dataset): DatasetConfig { id: 37362eef-c1b6-4314-9d44-575caa660704 (dataset), name: DatasetName { pool_name: ZpoolName { id: f3390b76-1a47-437d-b003-6296b24d9932 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 373f9c6a-0b64-4ea3-9f8c-245cdd5b18ea (dataset): DatasetConfig { id: 373f9c6a-0b64-4ea3-9f8c-245cdd5b18ea (dataset), name: DatasetName { pool_name: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a2c5485-fa72-490a-bc5e-4ae8252d90b2 (dataset): DatasetConfig { id: 3a2c5485-fa72-490a-bc5e-4ae8252d90b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8fbbea6c-76df-4af7-a25f-3e2c165ad855 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3dfc1606-5e86-4a7f-a50f-b4e11d5626b0 (dataset): DatasetConfig { id: 3dfc1606-5e86-4a7f-a50f-b4e11d5626b0 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3fb40f5a-973c-4239-9ddc-79f6f39cf9a0 (dataset): DatasetConfig { id: 3fb40f5a-973c-4239-9ddc-79f6f39cf9a0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8fbbea6c-76df-4af7-a25f-3e2c165ad855 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 42f5c677-1472-429a-bb59-b845eb6eb0be (dataset): DatasetConfig { id: 42f5c677-1472-429a-bb59-b845eb6eb0be (dataset), name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4373a50b-7e47-483b-b62a-a44095a1710e (dataset): DatasetConfig { id: 4373a50b-7e47-483b-b62a-a44095a1710e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4539eb6e-0bc8-43ad-af68-3df2bbdc9d49 (dataset): DatasetConfig { id: 4539eb6e-0bc8-43ad-af68-3df2bbdc9d49 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 497c6168-b22f-48bc-8081-1a7f307b1e20 (dataset): DatasetConfig { id: 497c6168-b22f-48bc-8081-1a7f307b1e20 (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 49f10212-2205-4717-879f-8eeb3f966c2e (dataset): DatasetConfig { id: 49f10212-2205-4717-879f-8eeb3f966c2e (dataset), name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4f89152b-5b01-4ee5-ab61-1d39ed48ebdf (dataset): DatasetConfig { id: 4f89152b-5b01-4ee5-ab61-1d39ed48ebdf (dataset), name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51d30e92-72b5-4ea8-bc84-225ffc238be3 (dataset): DatasetConfig { id: 51d30e92-72b5-4ea8-bc84-225ffc238be3 (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54beefa3-2624-4d77-997a-d5314563c823 (dataset): DatasetConfig { id: 54beefa3-2624-4d77-997a-d5314563c823 (dataset), name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 559a14b9-96cf-4240-820e-37ad30b2108f (dataset): DatasetConfig { id: 559a14b9-96cf-4240-820e-37ad30b2108f (dataset), name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5a524a24-bad7-4947-9ae4-943cfcc697ed (dataset): DatasetConfig { id: 5a524a24-bad7-4947-9ae4-943cfcc697ed (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5eb6e3a8-e6a5-41e7-8e18-ee7fe103e86c (dataset): DatasetConfig { id: 5eb6e3a8-e6a5-41e7-8e18-ee7fe103e86c (dataset), name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f1d688f-da20-4651-87b6-f979a4fbbdef (dataset): DatasetConfig { id: 5f1d688f-da20-4651-87b6-f979a4fbbdef (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61f2d031-5805-454c-bd14-7103875bbbc5 (dataset): DatasetConfig { id: 61f2d031-5805-454c-bd14-7103875bbbc5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 646ca40c-244c-4e86-b0d9-9924f9f5f89f (dataset): DatasetConfig { id: 646ca40c-244c-4e86-b0d9-9924f9f5f89f (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6956eff1-0ebc-4ea3-b2bb-e5ac9923cccb (dataset): DatasetConfig { id: 6956eff1-0ebc-4ea3-b2bb-e5ac9923cccb (dataset), name: DatasetName { pool_name: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6a84c922-fab4-4136-9822-9cae250211ce (dataset): DatasetConfig { id: 6a84c922-fab4-4136-9822-9cae250211ce (dataset), name: DatasetName { pool_name: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 73dbc95a-443f-4e70-8aa4-1993ec468609 (dataset): DatasetConfig { id: 73dbc95a-443f-4e70-8aa4-1993ec468609 (dataset), name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 753c81fa-2395-4372-9cdb-30af5defe7f7 (dataset): DatasetConfig { id: 753c81fa-2395-4372-9cdb-30af5defe7f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: f3390b76-1a47-437d-b003-6296b24d9932 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 779db738-3c09-4844-9326-2a8b8115c710 (dataset): DatasetConfig { id: 779db738-3c09-4844-9326-2a8b8115c710 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f1d4c07-7ea6-44bd-afd7-754aa6a50579 (dataset): DatasetConfig { id: 7f1d4c07-7ea6-44bd-afd7-754aa6a50579 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ff3f177-8156-4b35-8faf-59cbce88653b (dataset): DatasetConfig { id: 7ff3f177-8156-4b35-8faf-59cbce88653b (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e732489-012e-43bd-9983-7c132c483cc3 (dataset): DatasetConfig { id: 8e732489-012e-43bd-9983-7c132c483cc3 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f70fd83-fc21-447e-9c71-6fded48e8ed8 (dataset): DatasetConfig { id: 8f70fd83-fc21-447e-9c71-6fded48e8ed8 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 96ec2da3-77c4-4234-8115-a4ac47fd7fe2 (dataset): DatasetConfig { id: 96ec2da3-77c4-4234-8115-a4ac47fd7fe2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9ea6f395-61cd-4500-b53d-3223391a5150 (dataset): DatasetConfig { id: 9ea6f395-61cd-4500-b53d-3223391a5150 (dataset), name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ff9a237-5eb1-4811-8226-029c8fde3515 (dataset): DatasetConfig { id: 9ff9a237-5eb1-4811-8226-029c8fde3515 (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1221b44-6b96-4c4e-ba1d-0f158e23f763 (dataset): DatasetConfig { id: a1221b44-6b96-4c4e-ba1d-0f158e23f763 (dataset), name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1e4b120-7947-4ef0-bea0-80c4aede0e7e (dataset): DatasetConfig { id: a1e4b120-7947-4ef0-bea0-80c4aede0e7e (dataset), name: DatasetName { pool_name: ZpoolName { id: f3390b76-1a47-437d-b003-6296b24d9932 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a5dd2452-ae78-4542-bbc6-a460b9439f19 (dataset): DatasetConfig { id: a5dd2452-ae78-4542-bbc6-a460b9439f19 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa4f32f4-d827-4a64-ad1c-5f6d76822680 (dataset): DatasetConfig { id: aa4f32f4-d827-4a64-ad1c-5f6d76822680 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, aa7d4e8d-ac66-42e4-9131-58d792bd7fe0 (dataset): DatasetConfig { id: aa7d4e8d-ac66-42e4-9131-58d792bd7fe0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae7df5d1-15b6-48ea-be7f-854fbed60252 (dataset): DatasetConfig { id: ae7df5d1-15b6-48ea-be7f-854fbed60252 (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b145c0b8-f05c-460d-92fd-d0114b25c151 (dataset): DatasetConfig { id: b145c0b8-f05c-460d-92fd-d0114b25c151 (dataset), name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6b4c81f-b127-491f-9a6a-4c686190d257 (dataset): DatasetConfig { id: b6b4c81f-b127-491f-9a6a-4c686190d257 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b79047f3-5d98-477f-abd4-71ac967cc604 (dataset): DatasetConfig { id: b79047f3-5d98-477f-abd4-71ac967cc604 (dataset), name: DatasetName { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b81dfb37-5392-4dab-bd72-6661e83085d4 (dataset): DatasetConfig { id: b81dfb37-5392-4dab-bd72-6661e83085d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, be42214b-7c0d-4312-bb94-61bb781571d0 (dataset): DatasetConfig { id: be42214b-7c0d-4312-bb94-61bb781571d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bec6ce52-5aaa-4a6a-a495-1801662ff6cd (dataset): DatasetConfig { id: bec6ce52-5aaa-4a6a-a495-1801662ff6cd (dataset), name: DatasetName { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bef89141-c4eb-4905-a512-3846ca2dcadc (dataset): DatasetConfig { id: bef89141-c4eb-4905-a512-3846ca2dcadc (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c09ee609-4879-4920-9abf-8d4d227a36d3 (dataset): DatasetConfig { id: c09ee609-4879-4920-9abf-8d4d227a36d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c1de92c4-4ebe-4426-a91c-9ae3bd3914ed (dataset): DatasetConfig { id: c1de92c4-4ebe-4426-a91c-9ae3bd3914ed (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c4efaf25-67a8-4ac0-9e1d-3b773f40fa3d (dataset): DatasetConfig { id: c4efaf25-67a8-4ac0-9e1d-3b773f40fa3d (dataset), name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c8204bba-77e8-481e-a7b5-cc9449d528f4 (dataset): DatasetConfig { id: c8204bba-77e8-481e-a7b5-cc9449d528f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cb0fbc08-3f89-4916-9c09-baf676f3fdba (dataset): DatasetConfig { id: cb0fbc08-3f89-4916-9c09-baf676f3fdba (dataset), name: DatasetName { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d68777bf-05ef-47eb-8dd9-e753b081ba0b (dataset): DatasetConfig { id: d68777bf-05ef-47eb-8dd9-e753b081ba0b (dataset), name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, da0ea777-d5d8-470f-8247-cf8e9f76c61e (dataset): DatasetConfig { id: da0ea777-d5d8-470f-8247-cf8e9f76c61e (dataset), name: DatasetName { pool_name: ZpoolName { id: 8fbbea6c-76df-4af7-a25f-3e2c165ad855 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dd8b0529-9a49-4507-9dc6-9eb90bf22c4c (dataset): DatasetConfig { id: dd8b0529-9a49-4507-9dc6-9eb90bf22c4c (dataset), name: DatasetName { pool_name: ZpoolName { id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e0b76865-dcd1-4d51-a279-bceaee8f68cb (dataset): DatasetConfig { id: e0b76865-dcd1-4d51-a279-bceaee8f68cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e1ee4b2b-5a48-441b-873b-35bd33bfbdcd (dataset): DatasetConfig { id: e1ee4b2b-5a48-441b-873b-35bd33bfbdcd (dataset), name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb1a80fb-cd40-491f-ae55-f9656055cad9 (dataset): DatasetConfig { id: eb1a80fb-cd40-491f-ae55-f9656055cad9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f8631812-d7aa-47d7-80a4-95276d67035f (dataset): DatasetConfig { id: f8631812-d7aa-47d7-80a4-95276d67035f (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:457 sled_address = [fd00:1122:3344:101::1]:12345
4582024-11-14T16:52:09.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57315
4592024-11-14T16:52:09.644ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:850 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
4602024-11-14T16:52:09.645ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {00a0201f-ac94-494c-809d-d28badc9983a (dataset): DatasetConfig { id: 00a0201f-ac94-494c-809d-d28badc9983a (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 010ff1bb-83e6-45e8-9392-96bcfec29be4 (dataset): DatasetConfig { id: 010ff1bb-83e6-45e8-9392-96bcfec29be4 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 04259c8d-b11f-4800-8b1e-e01f1200229b (dataset): DatasetConfig { id: 04259c8d-b11f-4800-8b1e-e01f1200229b (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 054d0fce-d2ae-466d-879f-12f52e25bc09 (dataset): DatasetConfig { id: 054d0fce-d2ae-466d-879f-12f52e25bc09 (dataset), name: DatasetName { pool_name: ZpoolName { id: f3390b76-1a47-437d-b003-6296b24d9932 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b848153-e975-4186-b84a-4a096ae270ca (dataset): DatasetConfig { id: 0b848153-e975-4186-b84a-4a096ae270ca (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 19f5da16-14dc-4f19-b8cc-0b9d4311f273 (dataset): DatasetConfig { id: 19f5da16-14dc-4f19-b8cc-0b9d4311f273 (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1ebac74e-513e-45ba-9d6a-f74b998fe750 (dataset): DatasetConfig { id: 1ebac74e-513e-45ba-9d6a-f74b998fe750 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1efa081c-6c86-4d82-8680-7a79914ee8e9 (dataset): DatasetConfig { id: 1efa081c-6c86-4d82-8680-7a79914ee8e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8fbbea6c-76df-4af7-a25f-3e2c165ad855 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1f33bdfa-b0d9-478b-af5c-4802efe1c89c (dataset): DatasetConfig { id: 1f33bdfa-b0d9-478b-af5c-4802efe1c89c (dataset), name: DatasetName { pool_name: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1fa5b32d-2d9d-4f7e-87e5-4e4c65f38b0b (dataset): DatasetConfig { id: 1fa5b32d-2d9d-4f7e-87e5-4e4c65f38b0b (dataset), name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37362eef-c1b6-4314-9d44-575caa660704 (dataset): DatasetConfig { id: 37362eef-c1b6-4314-9d44-575caa660704 (dataset), name: DatasetName { pool_name: ZpoolName { id: f3390b76-1a47-437d-b003-6296b24d9932 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 373f9c6a-0b64-4ea3-9f8c-245cdd5b18ea (dataset): DatasetConfig { id: 373f9c6a-0b64-4ea3-9f8c-245cdd5b18ea (dataset), name: DatasetName { pool_name: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a2c5485-fa72-490a-bc5e-4ae8252d90b2 (dataset): DatasetConfig { id: 3a2c5485-fa72-490a-bc5e-4ae8252d90b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8fbbea6c-76df-4af7-a25f-3e2c165ad855 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3dfc1606-5e86-4a7f-a50f-b4e11d5626b0 (dataset): DatasetConfig { id: 3dfc1606-5e86-4a7f-a50f-b4e11d5626b0 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3fb40f5a-973c-4239-9ddc-79f6f39cf9a0 (dataset): DatasetConfig { id: 3fb40f5a-973c-4239-9ddc-79f6f39cf9a0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8fbbea6c-76df-4af7-a25f-3e2c165ad855 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 42f5c677-1472-429a-bb59-b845eb6eb0be (dataset): DatasetConfig { id: 42f5c677-1472-429a-bb59-b845eb6eb0be (dataset), name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4373a50b-7e47-483b-b62a-a44095a1710e (dataset): DatasetConfig { id: 4373a50b-7e47-483b-b62a-a44095a1710e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4539eb6e-0bc8-43ad-af68-3df2bbdc9d49 (dataset): DatasetConfig { id: 4539eb6e-0bc8-43ad-af68-3df2bbdc9d49 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 497c6168-b22f-48bc-8081-1a7f307b1e20 (dataset): DatasetConfig { id: 497c6168-b22f-48bc-8081-1a7f307b1e20 (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 49f10212-2205-4717-879f-8eeb3f966c2e (dataset): DatasetConfig { id: 49f10212-2205-4717-879f-8eeb3f966c2e (dataset), name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4f89152b-5b01-4ee5-ab61-1d39ed48ebdf (dataset): DatasetConfig { id: 4f89152b-5b01-4ee5-ab61-1d39ed48ebdf (dataset), name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51d30e92-72b5-4ea8-bc84-225ffc238be3 (dataset): DatasetConfig { id: 51d30e92-72b5-4ea8-bc84-225ffc238be3 (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54beefa3-2624-4d77-997a-d5314563c823 (dataset): DatasetConfig { id: 54beefa3-2624-4d77-997a-d5314563c823 (dataset), name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 559a14b9-96cf-4240-820e-37ad30b2108f (dataset): DatasetConfig { id: 559a14b9-96cf-4240-820e-37ad30b2108f (dataset), name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5a524a24-bad7-4947-9ae4-943cfcc697ed (dataset): DatasetConfig { id: 5a524a24-bad7-4947-9ae4-943cfcc697ed (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5eb6e3a8-e6a5-41e7-8e18-ee7fe103e86c (dataset): DatasetConfig { id: 5eb6e3a8-e6a5-41e7-8e18-ee7fe103e86c (dataset), name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f1d688f-da20-4651-87b6-f979a4fbbdef (dataset): DatasetConfig { id: 5f1d688f-da20-4651-87b6-f979a4fbbdef (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61f2d031-5805-454c-bd14-7103875bbbc5 (dataset): DatasetConfig { id: 61f2d031-5805-454c-bd14-7103875bbbc5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 646ca40c-244c-4e86-b0d9-9924f9f5f89f (dataset): DatasetConfig { id: 646ca40c-244c-4e86-b0d9-9924f9f5f89f (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6956eff1-0ebc-4ea3-b2bb-e5ac9923cccb (dataset): DatasetConfig { id: 6956eff1-0ebc-4ea3-b2bb-e5ac9923cccb (dataset), name: DatasetName { pool_name: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6a84c922-fab4-4136-9822-9cae250211ce (dataset): DatasetConfig { id: 6a84c922-fab4-4136-9822-9cae250211ce (dataset), name: DatasetName { pool_name: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 73dbc95a-443f-4e70-8aa4-1993ec468609 (dataset): DatasetConfig { id: 73dbc95a-443f-4e70-8aa4-1993ec468609 (dataset), name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 753c81fa-2395-4372-9cdb-30af5defe7f7 (dataset): DatasetConfig { id: 753c81fa-2395-4372-9cdb-30af5defe7f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: f3390b76-1a47-437d-b003-6296b24d9932 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 779db738-3c09-4844-9326-2a8b8115c710 (dataset): DatasetConfig { id: 779db738-3c09-4844-9326-2a8b8115c710 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f1d4c07-7ea6-44bd-afd7-754aa6a50579 (dataset): DatasetConfig { id: 7f1d4c07-7ea6-44bd-afd7-754aa6a50579 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ff3f177-8156-4b35-8faf-59cbce88653b (dataset): DatasetConfig { id: 7ff3f177-8156-4b35-8faf-59cbce88653b (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e732489-012e-43bd-9983-7c132c483cc3 (dataset): DatasetConfig { id: 8e732489-012e-43bd-9983-7c132c483cc3 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f70fd83-fc21-447e-9c71-6fded48e8ed8 (dataset): DatasetConfig { id: 8f70fd83-fc21-447e-9c71-6fded48e8ed8 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 96ec2da3-77c4-4234-8115-a4ac47fd7fe2 (dataset): DatasetConfig { id: 96ec2da3-77c4-4234-8115-a4ac47fd7fe2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9ea6f395-61cd-4500-b53d-3223391a5150 (dataset): DatasetConfig { id: 9ea6f395-61cd-4500-b53d-3223391a5150 (dataset), name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ff9a237-5eb1-4811-8226-029c8fde3515 (dataset): DatasetConfig { id: 9ff9a237-5eb1-4811-8226-029c8fde3515 (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1221b44-6b96-4c4e-ba1d-0f158e23f763 (dataset): DatasetConfig { id: a1221b44-6b96-4c4e-ba1d-0f158e23f763 (dataset), name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1e4b120-7947-4ef0-bea0-80c4aede0e7e (dataset): DatasetConfig { id: a1e4b120-7947-4ef0-bea0-80c4aede0e7e (dataset), name: DatasetName { pool_name: ZpoolName { id: f3390b76-1a47-437d-b003-6296b24d9932 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a5dd2452-ae78-4542-bbc6-a460b9439f19 (dataset): DatasetConfig { id: a5dd2452-ae78-4542-bbc6-a460b9439f19 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa4f32f4-d827-4a64-ad1c-5f6d76822680 (dataset): DatasetConfig { id: aa4f32f4-d827-4a64-ad1c-5f6d76822680 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, aa7d4e8d-ac66-42e4-9131-58d792bd7fe0 (dataset): DatasetConfig { id: aa7d4e8d-ac66-42e4-9131-58d792bd7fe0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae7df5d1-15b6-48ea-be7f-854fbed60252 (dataset): DatasetConfig { id: ae7df5d1-15b6-48ea-be7f-854fbed60252 (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b145c0b8-f05c-460d-92fd-d0114b25c151 (dataset): DatasetConfig { id: b145c0b8-f05c-460d-92fd-d0114b25c151 (dataset), name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6b4c81f-b127-491f-9a6a-4c686190d257 (dataset): DatasetConfig { id: b6b4c81f-b127-491f-9a6a-4c686190d257 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b79047f3-5d98-477f-abd4-71ac967cc604 (dataset): DatasetConfig { id: b79047f3-5d98-477f-abd4-71ac967cc604 (dataset), name: DatasetName { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b81dfb37-5392-4dab-bd72-6661e83085d4 (dataset): DatasetConfig { id: b81dfb37-5392-4dab-bd72-6661e83085d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, be42214b-7c0d-4312-bb94-61bb781571d0 (dataset): DatasetConfig { id: be42214b-7c0d-4312-bb94-61bb781571d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bec6ce52-5aaa-4a6a-a495-1801662ff6cd (dataset): DatasetConfig { id: bec6ce52-5aaa-4a6a-a495-1801662ff6cd (dataset), name: DatasetName { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bef89141-c4eb-4905-a512-3846ca2dcadc (dataset): DatasetConfig { id: bef89141-c4eb-4905-a512-3846ca2dcadc (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c09ee609-4879-4920-9abf-8d4d227a36d3 (dataset): DatasetConfig { id: c09ee609-4879-4920-9abf-8d4d227a36d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c1de92c4-4ebe-4426-a91c-9ae3bd3914ed (dataset): DatasetConfig { id: c1de92c4-4ebe-4426-a91c-9ae3bd3914ed (dataset), name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c4efaf25-67a8-4ac0-9e1d-3b773f40fa3d (dataset): DatasetConfig { id: c4efaf25-67a8-4ac0-9e1d-3b773f40fa3d (dataset), name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c8204bba-77e8-481e-a7b5-cc9449d528f4 (dataset): DatasetConfig { id: c8204bba-77e8-481e-a7b5-cc9449d528f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cb0fbc08-3f89-4916-9c09-baf676f3fdba (dataset): DatasetConfig { id: cb0fbc08-3f89-4916-9c09-baf676f3fdba (dataset), name: DatasetName { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d68777bf-05ef-47eb-8dd9-e753b081ba0b (dataset): DatasetConfig { id: d68777bf-05ef-47eb-8dd9-e753b081ba0b (dataset), name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, da0ea777-d5d8-470f-8247-cf8e9f76c61e (dataset): DatasetConfig { id: da0ea777-d5d8-470f-8247-cf8e9f76c61e (dataset), name: DatasetName { pool_name: ZpoolName { id: 8fbbea6c-76df-4af7-a25f-3e2c165ad855 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dd8b0529-9a49-4507-9dc6-9eb90bf22c4c (dataset): DatasetConfig { id: dd8b0529-9a49-4507-9dc6-9eb90bf22c4c (dataset), name: DatasetName { pool_name: ZpoolName { id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e0b76865-dcd1-4d51-a279-bceaee8f68cb (dataset): DatasetConfig { id: e0b76865-dcd1-4d51-a279-bceaee8f68cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e1ee4b2b-5a48-441b-873b-35bd33bfbdcd (dataset): DatasetConfig { id: e1ee4b2b-5a48-441b-873b-35bd33bfbdcd (dataset), name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb1a80fb-cd40-491f-ae55-f9656055cad9 (dataset): DatasetConfig { id: eb1a80fb-cd40-491f-ae55-f9656055cad9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f8631812-d7aa-47d7-80a4-95276d67035f (dataset): DatasetConfig { id: f8631812-d7aa-47d7-80a4-95276d67035f (dataset), name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4612024-11-14T16:52:09.645ZINFOSledAgent (StorageManager): No ledger in /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4622024-11-14T16:52:09.645ZINFOSledAgent (StorageManager): No ledger in /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4632024-11-14T16:52:09.645ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4642024-11-14T16:52:09.645ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4652024-11-14T16:52:09.645ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da94b0fc-e114-4d62-8eee-1f3b839145a7/crypt/zone/oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2"), full_name: "oxp_da94b0fc-e114-4d62-8eee-1f3b839145a7/crypt/zone/oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2" } file = sled-storage/src/manager.rs:1331
4662024-11-14T16:52:09.690ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43) file = sled-agent/src/probe_manager.rs:231 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
4672024-11-14T16:52:09.743ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4682024-11-14T16:52:09.743ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad871e3f-9a86-4a01-ac75-964bae58e4aa/crypt/zone/oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740"), full_name: "oxp_ad871e3f-9a86-4a01-ac75-964bae58e4aa/crypt/zone/oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740" } file = sled-storage/src/manager.rs:1331
4692024-11-14T16:52:09.843ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4702024-11-14T16:52:09.843ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0e37ddab-daec-4c38-a903-78b351e48433/crypt/zone/oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186"), full_name: "oxp_0e37ddab-daec-4c38-a903-78b351e48433/crypt/zone/oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186" } file = sled-storage/src/manager.rs:1331
4712024-11-14T16:52:09.943ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4722024-11-14T16:52:09.943ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f3390b76-1a47-437d-b003-6296b24d9932/crypt/zone/oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4"), full_name: "oxp_f3390b76-1a47-437d-b003-6296b24d9932/crypt/zone/oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4" } file = sled-storage/src/manager.rs:1331
4732024-11-14T16:52:10.041ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4742024-11-14T16:52:10.041ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_da94b0fc-e114-4d62-8eee-1f3b839145a7/crucible" } file = sled-storage/src/manager.rs:1331
4752024-11-14T16:52:10.127ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4762024-11-14T16:52:10.127ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_da94b0fc-e114-4d62-8eee-1f3b839145a7/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
4772024-11-14T16:52:10.216ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4782024-11-14T16:52:10.217ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad871e3f-9a86-4a01-ac75-964bae58e4aa/crypt/zone/oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c"), full_name: "oxp_ad871e3f-9a86-4a01-ac75-964bae58e4aa/crypt/zone/oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c" } file = sled-storage/src/manager.rs:1331
4792024-11-14T16:52:10.312ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4802024-11-14T16:52:10.312ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8fbbea6c-76df-4af7-a25f-3e2c165ad855/crypt/zone"), full_name: "oxp_8fbbea6c-76df-4af7-a25f-3e2c165ad855/crypt/zone" } file = sled-storage/src/manager.rs:1331
4812024-11-14T16:52:10.380ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4822024-11-14T16:52:10.380ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad871e3f-9a86-4a01-ac75-964bae58e4aa/crypt/zone/oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561"), full_name: "oxp_ad871e3f-9a86-4a01-ac75-964bae58e4aa/crypt/zone/oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561" } file = sled-storage/src/manager.rs:1331
4832024-11-14T16:52:10.485ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4842024-11-14T16:52:10.485ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e573afbb-ee4c-4f2d-9d08-b65b7fca29cf/crypt/zone/oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725"), full_name: "oxp_e573afbb-ee4c-4f2d-9d08-b65b7fca29cf/crypt/zone/oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725" } file = sled-storage/src/manager.rs:1331
4852024-11-14T16:52:10.585ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4862024-11-14T16:52:10.585ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f3390b76-1a47-437d-b003-6296b24d9932/crucible" } file = sled-storage/src/manager.rs:1331
4872024-11-14T16:52:10.674ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4882024-11-14T16:52:10.674ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad871e3f-9a86-4a01-ac75-964bae58e4aa/crypt/zone"), full_name: "oxp_ad871e3f-9a86-4a01-ac75-964bae58e4aa/crypt/zone" } file = sled-storage/src/manager.rs:1331
4892024-11-14T16:52:10.692ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43) file = sled-agent/src/probe_manager.rs:231 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
4902024-11-14T16:52:10.743ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4912024-11-14T16:52:10.743ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8fbbea6c-76df-4af7-a25f-3e2c165ad855/crypt/zone/oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082"), full_name: "oxp_8fbbea6c-76df-4af7-a25f-3e2c165ad855/crypt/zone/oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082" } file = sled-storage/src/manager.rs:1331
4922024-11-14T16:52:10.844ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4932024-11-14T16:52:10.844ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad871e3f-9a86-4a01-ac75-964bae58e4aa/crypt/debug"), full_name: "oxp_ad871e3f-9a86-4a01-ac75-964bae58e4aa/crypt/debug" } file = sled-storage/src/manager.rs:1331
4942024-11-14T16:52:10.917ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4952024-11-14T16:52:10.917ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8fbbea6c-76df-4af7-a25f-3e2c165ad855/crypt/debug"), full_name: "oxp_8fbbea6c-76df-4af7-a25f-3e2c165ad855/crypt/debug" } file = sled-storage/src/manager.rs:1331
4962024-11-14T16:52:10.986ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4972024-11-14T16:52:10.987ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a47fbfc2-afec-46c8-bc5a-f6c02b232d2e/crypt/zone/oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057"), full_name: "oxp_a47fbfc2-afec-46c8-bc5a-f6c02b232d2e/crypt/zone/oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057" } file = sled-storage/src/manager.rs:1331
4982024-11-14T16:52:11.087ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4992024-11-14T16:52:11.087ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0e37ddab-daec-4c38-a903-78b351e48433/crypt/zone/oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272"), full_name: "oxp_0e37ddab-daec-4c38-a903-78b351e48433/crypt/zone/oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272" } file = sled-storage/src/manager.rs:1331
5002024-11-14T16:52:11.188ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5012024-11-14T16:52:11.188ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0e37ddab-daec-4c38-a903-78b351e48433/crucible" } file = sled-storage/src/manager.rs:1331
5022024-11-14T16:52:11.278ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5032024-11-14T16:52:11.278ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da94b0fc-e114-4d62-8eee-1f3b839145a7/crypt/zone/oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7"), full_name: "oxp_da94b0fc-e114-4d62-8eee-1f3b839145a7/crypt/zone/oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7" } file = sled-storage/src/manager.rs:1331
5042024-11-14T16:52:11.378ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5052024-11-14T16:52:11.378ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a47fbfc2-afec-46c8-bc5a-f6c02b232d2e/crypt/zone/oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9"), full_name: "oxp_a47fbfc2-afec-46c8-bc5a-f6c02b232d2e/crypt/zone/oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9" } file = sled-storage/src/manager.rs:1331
5062024-11-14T16:52:11.476ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5072024-11-14T16:52:11.476ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e573afbb-ee4c-4f2d-9d08-b65b7fca29cf/crypt/zone/oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8"), full_name: "oxp_e573afbb-ee4c-4f2d-9d08-b65b7fca29cf/crypt/zone/oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8" } file = sled-storage/src/manager.rs:1331
5082024-11-14T16:52:11.577ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5092024-11-14T16:52:11.577ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da94b0fc-e114-4d62-8eee-1f3b839145a7/crypt/zone"), full_name: "oxp_da94b0fc-e114-4d62-8eee-1f3b839145a7/crypt/zone" } file = sled-storage/src/manager.rs:1331
5102024-11-14T16:52:11.646ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5112024-11-14T16:52:11.646ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e573afbb-ee4c-4f2d-9d08-b65b7fca29cf/crypt/zone/oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495"), full_name: "oxp_e573afbb-ee4c-4f2d-9d08-b65b7fca29cf/crypt/zone/oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495" } file = sled-storage/src/manager.rs:1331
5122024-11-14T16:52:11.694ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43) file = sled-agent/src/probe_manager.rs:231 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
5132024-11-14T16:52:11.746ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5142024-11-14T16:52:11.746ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a47fbfc2-afec-46c8-bc5a-f6c02b232d2e/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5152024-11-14T16:52:11.836ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5162024-11-14T16:52:11.836ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_da94b0fc-e114-4d62-8eee-1f3b839145a7/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5172024-11-14T16:52:11.927ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5182024-11-14T16:52:11.927ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e573afbb-ee4c-4f2d-9d08-b65b7fca29cf/crypt/zone"), full_name: "oxp_e573afbb-ee4c-4f2d-9d08-b65b7fca29cf/crypt/zone" } file = sled-storage/src/manager.rs:1331
5192024-11-14T16:52:11.996ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5202024-11-14T16:52:11.996ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_da94b0fc-e114-4d62-8eee-1f3b839145a7/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5212024-11-14T16:52:12.085ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5222024-11-14T16:52:12.085ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/63c85555-7e85-4f53-92b1-afc3cd212893/crypt/debug"), full_name: "oxp_63c85555-7e85-4f53-92b1-afc3cd212893/crypt/debug" } file = sled-storage/src/manager.rs:1331
5232024-11-14T16:52:12.155ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5242024-11-14T16:52:12.155ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da94b0fc-e114-4d62-8eee-1f3b839145a7/crypt/debug"), full_name: "oxp_da94b0fc-e114-4d62-8eee-1f3b839145a7/crypt/debug" } file = sled-storage/src/manager.rs:1331
5252024-11-14T16:52:12.223ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5262024-11-14T16:52:12.223ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ad871e3f-9a86-4a01-ac75-964bae58e4aa/crucible" } file = sled-storage/src/manager.rs:1331
5272024-11-14T16:52:12.313ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5282024-11-14T16:52:12.313ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad871e3f-9a86-4a01-ac75-964bae58e4aa/crypt/zone/oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197"), full_name: "oxp_ad871e3f-9a86-4a01-ac75-964bae58e4aa/crypt/zone/oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197" } file = sled-storage/src/manager.rs:1331
5292024-11-14T16:52:12.339ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 16.043669762s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
5302024-11-14T16:52:12.411ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5312024-11-14T16:52:12.411ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a47fbfc2-afec-46c8-bc5a-f6c02b232d2e/crypt/debug"), full_name: "oxp_a47fbfc2-afec-46c8-bc5a-f6c02b232d2e/crypt/debug" } file = sled-storage/src/manager.rs:1331
5322024-11-14T16:52:12.484ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5332024-11-14T16:52:12.484ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f3390b76-1a47-437d-b003-6296b24d9932/crypt/debug"), full_name: "oxp_f3390b76-1a47-437d-b003-6296b24d9932/crypt/debug" } file = sled-storage/src/manager.rs:1331
5342024-11-14T16:52:12.551ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5352024-11-14T16:52:12.552ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0e37ddab-daec-4c38-a903-78b351e48433/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5362024-11-14T16:52:12.639ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5372024-11-14T16:52:12.639ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0e37ddab-daec-4c38-a903-78b351e48433/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5382024-11-14T16:52:12.696ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43) file = sled-agent/src/probe_manager.rs:231 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
5392024-11-14T16:52:12.724ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5402024-11-14T16:52:12.725ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0e37ddab-daec-4c38-a903-78b351e48433/crypt/zone/oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f"), full_name: "oxp_0e37ddab-daec-4c38-a903-78b351e48433/crypt/zone/oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f" } file = sled-storage/src/manager.rs:1331
5412024-11-14T16:52:12.820ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5422024-11-14T16:52:12.820ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c/crypt/zone/oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2"), full_name: "oxp_ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c/crypt/zone/oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2" } file = sled-storage/src/manager.rs:1331
5432024-11-14T16:52:12.916ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5442024-11-14T16:52:12.916ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad871e3f-9a86-4a01-ac75-964bae58e4aa/crypt/zone/oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2"), full_name: "oxp_ad871e3f-9a86-4a01-ac75-964bae58e4aa/crypt/zone/oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2" } file = sled-storage/src/manager.rs:1331
5452024-11-14T16:52:13.014ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5462024-11-14T16:52:13.014ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0e37ddab-daec-4c38-a903-78b351e48433/crypt/debug"), full_name: "oxp_0e37ddab-daec-4c38-a903-78b351e48433/crypt/debug" } file = sled-storage/src/manager.rs:1331
5472024-11-14T16:52:13.080ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5482024-11-14T16:52:13.080ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a47fbfc2-afec-46c8-bc5a-f6c02b232d2e/crypt/zone"), full_name: "oxp_a47fbfc2-afec-46c8-bc5a-f6c02b232d2e/crypt/zone" } file = sled-storage/src/manager.rs:1331
5492024-11-14T16:52:13.148ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5502024-11-14T16:52:13.148ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da94b0fc-e114-4d62-8eee-1f3b839145a7/crypt/zone/oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e"), full_name: "oxp_da94b0fc-e114-4d62-8eee-1f3b839145a7/crypt/zone/oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e" } file = sled-storage/src/manager.rs:1331
5512024-11-14T16:52:13.246ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5522024-11-14T16:52:13.246ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a47fbfc2-afec-46c8-bc5a-f6c02b232d2e/crypt/zone/oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105"), full_name: "oxp_a47fbfc2-afec-46c8-bc5a-f6c02b232d2e/crypt/zone/oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105" } file = sled-storage/src/manager.rs:1331
5532024-11-14T16:52:13.347ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5542024-11-14T16:52:13.347ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f3390b76-1a47-437d-b003-6296b24d9932/crypt/zone"), full_name: "oxp_f3390b76-1a47-437d-b003-6296b24d9932/crypt/zone" } file = sled-storage/src/manager.rs:1331
5552024-11-14T16:52:13.414ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5562024-11-14T16:52:13.414ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0e37ddab-daec-4c38-a903-78b351e48433/crypt/zone/oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101"), full_name: "oxp_0e37ddab-daec-4c38-a903-78b351e48433/crypt/zone/oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101" } file = sled-storage/src/manager.rs:1331
5572024-11-14T16:52:13.514ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5582024-11-14T16:52:13.514ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c/crypt/debug"), full_name: "oxp_ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c/crypt/debug" } file = sled-storage/src/manager.rs:1331
5592024-11-14T16:52:13.581ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5602024-11-14T16:52:13.581ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/63c85555-7e85-4f53-92b1-afc3cd212893/crypt/zone/oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575"), full_name: "oxp_63c85555-7e85-4f53-92b1-afc3cd212893/crypt/zone/oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575" } file = sled-storage/src/manager.rs:1331
5612024-11-14T16:52:13.695ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5622024-11-14T16:52:13.695ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da94b0fc-e114-4d62-8eee-1f3b839145a7/crypt/zone/oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a"), full_name: "oxp_da94b0fc-e114-4d62-8eee-1f3b839145a7/crypt/zone/oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a" } file = sled-storage/src/manager.rs:1331
5632024-11-14T16:52:13.699ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43) file = sled-agent/src/probe_manager.rs:231 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
5642024-11-14T16:52:13.800ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5652024-11-14T16:52:13.800ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a47fbfc2-afec-46c8-bc5a-f6c02b232d2e/crucible" } file = sled-storage/src/manager.rs:1331
5662024-11-14T16:52:13.891ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5672024-11-14T16:52:13.891ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c/crypt/zone/oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6"), full_name: "oxp_ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c/crypt/zone/oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6" } file = sled-storage/src/manager.rs:1331
5682024-11-14T16:52:13.992ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5692024-11-14T16:52:13.992ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/63c85555-7e85-4f53-92b1-afc3cd212893/crypt/zone/oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8"), full_name: "oxp_63c85555-7e85-4f53-92b1-afc3cd212893/crypt/zone/oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8" } file = sled-storage/src/manager.rs:1331
5702024-11-14T16:52:14.093ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5712024-11-14T16:52:14.093ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c/crypt/zone"), full_name: "oxp_ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c/crypt/zone" } file = sled-storage/src/manager.rs:1331
5722024-11-14T16:52:14.161ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5732024-11-14T16:52:14.162ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0e37ddab-daec-4c38-a903-78b351e48433/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5742024-11-14T16:52:14.251ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5752024-11-14T16:52:14.252ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/63c85555-7e85-4f53-92b1-afc3cd212893/crypt/zone"), full_name: "oxp_63c85555-7e85-4f53-92b1-afc3cd212893/crypt/zone" } file = sled-storage/src/manager.rs:1331
5762024-11-14T16:52:14.319ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5772024-11-14T16:52:14.319ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_da94b0fc-e114-4d62-8eee-1f3b839145a7/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5782024-11-14T16:52:14.411ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5792024-11-14T16:52:14.411ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e573afbb-ee4c-4f2d-9d08-b65b7fca29cf/crucible" } file = sled-storage/src/manager.rs:1331
5802024-11-14T16:52:14.504ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5812024-11-14T16:52:14.504ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da94b0fc-e114-4d62-8eee-1f3b839145a7/crypt/zone/oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb"), full_name: "oxp_da94b0fc-e114-4d62-8eee-1f3b839145a7/crypt/zone/oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb" } file = sled-storage/src/manager.rs:1331
5822024-11-14T16:52:14.609ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5832024-11-14T16:52:14.609ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a47fbfc2-afec-46c8-bc5a-f6c02b232d2e/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5842024-11-14T16:52:14.698ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5852024-11-14T16:52:14.699ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a47fbfc2-afec-46c8-bc5a-f6c02b232d2e/crypt/zone/oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f"), full_name: "oxp_a47fbfc2-afec-46c8-bc5a-f6c02b232d2e/crypt/zone/oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f" } file = sled-storage/src/manager.rs:1331
5862024-11-14T16:52:14.702ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43) file = sled-agent/src/probe_manager.rs:231 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
5872024-11-14T16:52:14.800ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5882024-11-14T16:52:14.800ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_63c85555-7e85-4f53-92b1-afc3cd212893/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5892024-11-14T16:52:14.890ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5902024-11-14T16:52:14.890ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e573afbb-ee4c-4f2d-9d08-b65b7fca29cf/crypt/debug"), full_name: "oxp_e573afbb-ee4c-4f2d-9d08-b65b7fca29cf/crypt/debug" } file = sled-storage/src/manager.rs:1331
5912024-11-14T16:52:14.964ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
5922024-11-14T16:52:14.964ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
5932024-11-14T16:52:14.966ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5942024-11-14T16:52:14.966ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8fbbea6c-76df-4af7-a25f-3e2c165ad855/crucible" } file = sled-storage/src/manager.rs:1331
5952024-11-14T16:52:14.971ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
5962024-11-14T16:52:14.971ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
5972024-11-14T16:52:15.072ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5982024-11-14T16:52:15.072ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c/crucible" } file = sled-storage/src/manager.rs:1331
5992024-11-14T16:52:15.133ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
6002024-11-14T16:52:15.133ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
6012024-11-14T16:52:15.175ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6022024-11-14T16:52:15.175ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0e37ddab-daec-4c38-a903-78b351e48433/crypt/zone"), full_name: "oxp_0e37ddab-daec-4c38-a903-78b351e48433/crypt/zone" } file = sled-storage/src/manager.rs:1331
6032024-11-14T16:52:15.181ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
6042024-11-14T16:52:15.181ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
6052024-11-14T16:52:15.235ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
6062024-11-14T16:52:15.235ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
6072024-11-14T16:52:15.252ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6082024-11-14T16:52:15.252ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e573afbb-ee4c-4f2d-9d08-b65b7fca29cf/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
6092024-11-14T16:52:15.256ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
6102024-11-14T16:52:15.256ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
6112024-11-14T16:52:15.330ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
6122024-11-14T16:52:15.330ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
6132024-11-14T16:52:15.354ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6142024-11-14T16:52:15.354ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_63c85555-7e85-4f53-92b1-afc3cd212893/crucible" } file = sled-storage/src/manager.rs:1331
6152024-11-14T16:52:15.424ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
6162024-11-14T16:52:15.424ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6172024-11-14T16:52:15.455ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6182024-11-14T16:52:15.455ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0e37ddab-daec-4c38-a903-78b351e48433/crypt/zone/oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c"), full_name: "oxp_0e37ddab-daec-4c38-a903-78b351e48433/crypt/zone/oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c" } file = sled-storage/src/manager.rs:1331
6192024-11-14T16:52:15.469ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:418
6202024-11-14T16:52:15.469ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/f70fbf74-7489-439f-8ec3-e6e8473a8b43) file = sled-agent/src/nexus.rs:527 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
6212024-11-14T16:52:15.507ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:686
6222024-11-14T16:52:15.508ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:731
6232024-11-14T16:52:15.508ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:734 uptime = 1
6242024-11-14T16:52:15.508ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:440
6252024-11-14T16:52:15.558ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6262024-11-14T16:52:15.558ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6272024-11-14T16:52:15.558ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:852 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
6282024-11-14T16:52:15.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5914332 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:57315 req_id = b7b5d636-9434-4e9d-bea5-e33e6edf6638 response_code = 200 uri = /datasets
6292024-11-14T16:52:15.560ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
6302024-11-14T16:52:15.609ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 89b01be2-c37f-445d-addd-6b4be9cd73c2 (service), filesystem_pool: Some(ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: bc5fdca1-6d92-4ff4-b5ae-2f44553a2186 (service), filesystem_pool: Some(ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: c3fb510c-8c5c-4a83-b5d7-4e199ba14057 (service), filesystem_pool: Some(ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
6312024-11-14T16:52:15.609ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50031
6322024-11-14T16:52:15.610ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 89b01be2-c37f-445d-addd-6b4be9cd73c2, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6332024-11-14T16:52:15.610ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 89b01be2-c37f-445d-addd-6b4be9cd73c2, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6342024-11-14T16:52:15.643ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6352024-11-14T16:52:15.643ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6362024-11-14T16:52:15.643ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6372024-11-14T16:52:15.643ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6382024-11-14T16:52:15.643ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6392024-11-14T16:52:15.643ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6402024-11-14T16:52:15.643ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6412024-11-14T16:52:15.643ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6422024-11-14T16:52:15.643ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6432024-11-14T16:52:15.643ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6442024-11-14T16:52:15.643ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6452024-11-14T16:52:15.643ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6462024-11-14T16:52:15.643ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6472024-11-14T16:52:15.643ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6482024-11-14T16:52:15.643ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6492024-11-14T16:52:15.643ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6502024-11-14T16:52:15.643ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6512024-11-14T16:52:15.643ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6522024-11-14T16:52:15.643ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6532024-11-14T16:52:15.643ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6542024-11-14T16:52:15.643ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6552024-11-14T16:52:15.643ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6562024-11-14T16:52:15.643ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6572024-11-14T16:52:15.643ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bc5fdca1-6d92-4ff4-b5ae-2f44553a2186, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6582024-11-14T16:52:15.643ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: bc5fdca1-6d92-4ff4-b5ae-2f44553a2186, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6592024-11-14T16:52:15.650ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15815800456525354001 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
6602024-11-14T16:52:15.651ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10686162021156357139 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
6612024-11-14T16:52:15.672ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c3fb510c-8c5c-4a83-b5d7-4e199ba14057, dataset_name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6622024-11-14T16:52:15.672ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c3fb510c-8c5c-4a83-b5d7-4e199ba14057, dataset_name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: InternalDns }, responder: ... }
6632024-11-14T16:52:15.700ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6642024-11-14T16:52:15.701ZINFOSledAgent (ServiceManager): No ledger in /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/omicron-zones.json file = common/src/ledger.rs:188
6652024-11-14T16:52:15.701ZINFOSledAgent (ServiceManager): No ledger in /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/omicron-zones.json file = common/src/ledger.rs:188
6662024-11-14T16:52:15.701ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6672024-11-14T16:52:15.707ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43) file = sled-agent/src/probe_manager.rs:231 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
6682024-11-14T16:52:15.741ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6692024-11-14T16:52:15.741ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6702024-11-14T16:52:15.741ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6712024-11-14T16:52:15.794ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2 file = illumos-utils/src/zone.rs:325
6722024-11-14T16:52:15.798ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186 file = illumos-utils/src/zone.rs:325
6732024-11-14T16:52:15.802ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057 file = illumos-utils/src/zone.rs:325
6742024-11-14T16:52:15.813ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2 file = illumos-utils/src/zone.rs:363
6752024-11-14T16:52:15.818ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186 file = illumos-utils/src/zone.rs:363
6762024-11-14T16:52:15.822ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057 file = illumos-utils/src/zone.rs:363
6772024-11-14T16:52:16.102ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13867837908407612504 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
6782024-11-14T16:52:16.102ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 234981320897751439 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
6792024-11-14T16:52:16.709ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f70fbf74-7489-439f-8ec3-e6e8473a8b43) file = sled-agent/src/probe_manager.rs:231 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
6802024-11-14T16:52:17.442ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6812024-11-14T16:52:17.442ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6822024-11-14T16:52:17.919ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6832024-11-14T16:52:17.920ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057
6842024-11-14T16:52:17.924ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6852024-11-14T16:52:18.405ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6862024-11-14T16:52:18.405ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186
6872024-11-14T16:52:18.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057") failed: Property not found. retry in 31.066785ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057
6882024-11-14T16:52:18.421ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6892024-11-14T16:52:18.421ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2
6902024-11-14T16:52:18.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057") failed: Property not found. retry in 62.156496ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057
6912024-11-14T16:52:18.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057") failed: Property not found. retry in 252.454559ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057
6922024-11-14T16:52:18.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186") failed: Property not found. retry in 48.158691ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186
6932024-11-14T16:52:18.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2") failed: Property not found. retry in 42.422318ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2
6942024-11-14T16:52:18.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186") failed: Property not found. retry in 119.841549ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186
6952024-11-14T16:52:18.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2") failed: Property not found. retry in 103.657539ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2
6962024-11-14T16:52:18.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2") failed: Property not found. retry in 111.908941ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2
6972024-11-14T16:52:18.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186") failed: Property not found. retry in 225.671288ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186
6982024-11-14T16:52:18.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057") failed: Property not found. retry in 397.986642ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057
6992024-11-14T16:52:18.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2") failed: Property not found. retry in 343.986508ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2
7002024-11-14T16:52:19.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186") failed: Property not found. retry in 572.618786ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186
7012024-11-14T16:52:19.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2") failed: Property not found. retry in 448.520887ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2
7022024-11-14T16:52:19.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057") failed: Property not found. retry in 1.017320574s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057
7032024-11-14T16:52:19.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186") failed: Property not found. retry in 919.227358ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186
7042024-11-14T16:52:19.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2") failed: Property not found. retry in 861.578556ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2
7052024-11-14T16:52:20.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057") failed: Property not found. retry in 692.761623ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057
7062024-11-14T16:52:20.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2") failed: Property not found. retry in 606.819463ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2
7072024-11-14T16:52:20.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186") failed: Property not found. retry in 770.637481ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186
7082024-11-14T16:52:21.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057") failed: Property not found. retry in 1.16210377s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057
7092024-11-14T16:52:21.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2") failed: Property not found. retry in 578.156534ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2
7102024-11-14T16:52:21.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186") failed: Property not found. retry in 611.969656ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186
7112024-11-14T16:52:21.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2") failed: Property not found. retry in 1.095930226s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2
7122024-11-14T16:52:22.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186") failed: Property not found. retry in 710.050116ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186
7132024-11-14T16:52:22.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057") failed: Property not found. retry in 1.108294525s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057
7142024-11-14T16:52:22.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186") failed: Property not found. retry in 1.06964091s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186
7152024-11-14T16:52:22.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2") failed: Property not found. retry in 905.563405ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2
7162024-11-14T16:52:23.848ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_89b01be2-c37f-445d-addd-6b4be9cd73c2
7172024-11-14T16:52:23.848ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_bc5fdca1-6d92-4ff4-b5ae-2f44553a2186
7182024-11-14T16:52:23.848ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_c3fb510c-8c5c-4a83-b5d7-4e199ba14057
7192024-11-14T16:52:23.848ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7202024-11-14T16:52:23.848ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7212024-11-14T16:52:23.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8239144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:50031 req_id = aa78b73b-dfa8-49aa-8257-230effebb64c response_code = 204 uri = /omicron-zones
7222024-11-14T16:52:23.850ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7232024-11-14T16:52:24.477ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 53.185546ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:675
7242024-11-14T16:52:24.531ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 168.285747ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:675
7252024-11-14T16:52:24.717ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7262024-11-14T16:52:24.765ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7272024-11-14T16:52:24.810ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:691
7282024-11-14T16:52:24.810ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7292024-11-14T16:52:24.843ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7302024-11-14T16:52:24.845ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7312024-11-14T16:52:24.845ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7322024-11-14T16:52:24.874ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 89b01be2-c37f-445d-addd-6b4be9cd73c2 (service), filesystem_pool: Some(ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: bc5fdca1-6d92-4ff4-b5ae-2f44553a2186 (service), filesystem_pool: Some(ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: c3fb510c-8c5c-4a83-b5d7-4e199ba14057 (service), filesystem_pool: Some(ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 322bbd3c-708a-4aa9-b0e5-71bef219bdc2 (service), filesystem_pool: Some(ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 4c470dad-04c1-4a2e-b885-22e9e25a1515, kind: Service { id: 322bbd3c-708a-4aa9-b0e5-71bef219bdc2 }, name: Name("ntp-322bbd3c-708a-4aa9-b0e5-71bef219bdc2"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 197])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
7332024-11-14T16:52:24.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57753
7342024-11-14T16:52:24.875ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 89b01be2-c37f-445d-addd-6b4be9cd73c2, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7352024-11-14T16:52:24.875ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 89b01be2-c37f-445d-addd-6b4be9cd73c2, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7362024-11-14T16:52:24.912ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bc5fdca1-6d92-4ff4-b5ae-2f44553a2186, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7372024-11-14T16:52:24.912ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: bc5fdca1-6d92-4ff4-b5ae-2f44553a2186, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7382024-11-14T16:52:24.947ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c3fb510c-8c5c-4a83-b5d7-4e199ba14057, dataset_name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7392024-11-14T16:52:24.947ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c3fb510c-8c5c-4a83-b5d7-4e199ba14057, dataset_name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: InternalDns }, responder: ... }
7402024-11-14T16:52:24.981ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7412024-11-14T16:52:24.981ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/omicron-zones.json file = common/src/ledger.rs:177
7422024-11-14T16:52:24.981ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/omicron-zones.json file = common/src/ledger.rs:177
7432024-11-14T16:52:24.981ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7442024-11-14T16:52:24.992ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7452024-11-14T16:52:25.025ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7462024-11-14T16:52:25.026ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7472024-11-14T16:52:25.026ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7482024-11-14T16:52:25.055ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 193, 197]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7492024-11-14T16:52:25.055ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7502024-11-14T16:52:25.056ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7512024-11-14T16:52:25.056ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7522024-11-14T16:52:25.056ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7532024-11-14T16:52:25.056ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7542024-11-14T16:52:25.082ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2 file = illumos-utils/src/zone.rs:325
7552024-11-14T16:52:25.100ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2 file = illumos-utils/src/zone.rs:363
7562024-11-14T16:52:25.654ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15815800456525354001 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
7572024-11-14T16:52:25.654ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10686162021156357139 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
7582024-11-14T16:52:25.711ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7592024-11-14T16:52:25.711ZINFOSledAgent (ServiceManager): Booting oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2
7602024-11-14T16:52:25.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2") failed: Property not found. retry in 35.546097ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2
7612024-11-14T16:52:25.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2") failed: Property not found. retry in 137.613441ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2
7622024-11-14T16:52:26.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2") failed: Property not found. retry in 265.253806ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2
7632024-11-14T16:52:26.104ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13867837908407612504 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
7642024-11-14T16:52:26.105ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 234981320897751439 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
7652024-11-14T16:52:26.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2") failed: Property not found. retry in 352.657054ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2
7662024-11-14T16:52:26.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2") failed: Property not found. retry in 879.977808ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2
7672024-11-14T16:52:27.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2") failed: Property not found. retry in 831.751163ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2
7682024-11-14T16:52:28.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2") failed: Property not found. retry in 820.148867ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2
7692024-11-14T16:52:29.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2") failed: Property not found. retry in 1.383999448s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2
7702024-11-14T16:52:30.660ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2
7712024-11-14T16:52:30.660ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7722024-11-14T16:52:30.661ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7732024-11-14T16:52:30.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5786623 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:57753 req_id = 1816567c-094e-4491-ae5d-be212bd34901 response_code = 204 uri = /omicron-zones
7742024-11-14T16:52:30.664ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:732
7752024-11-14T16:52:30.693ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7762024-11-14T16:52:30.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40240
7772024-11-14T16:52:30.704ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7782024-11-14T16:52:30.704ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 10631 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40240 req_id = f328a895-6f13-4a4a-be49-4bd25f1420de response_code = 500 uri = /timesync
7792024-11-14T16:52:30.707ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7802024-11-14T16:52:30.812ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7812024-11-14T16:52:30.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50515
7822024-11-14T16:52:33.348ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 952932412618715883 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
7832024-11-14T16:52:33.845ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 877716492045759641 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
7842024-11-14T16:52:33.850ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11284951308758431379 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
7852024-11-14T16:52:34.821ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7862024-11-14T16:52:34.821ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008585 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50515 req_id = 08f497fe-0192-4880-96d9-23f1980488d1 response_code = 500 uri = /timesync
7872024-11-14T16:52:34.824ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7882024-11-14T16:52:34.933ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7892024-11-14T16:52:34.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63867
7902024-11-14T16:52:34.941ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7912024-11-14T16:52:34.941ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8430 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63867 req_id = b874a3ca-3196-4470-b0fd-3acf5a8d886b response_code = 500 uri = /timesync
7922024-11-14T16:52:34.944ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7932024-11-14T16:52:35.150ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7942024-11-14T16:52:35.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33649
7952024-11-14T16:52:35.158ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_322bbd3c-708a-4aa9-b0e5-71bef219bdc2': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7962024-11-14T16:52:35.159ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8427 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33649 req_id = e7554b40-9774-4d35-aae3-0134d71ec109 response_code = 500 uri = /timesync
7972024-11-14T16:52:35.161ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7982024-11-14T16:52:35.374ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7992024-11-14T16:52:35.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35836
8002024-11-14T16:52:35.657ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15815800456525354001 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
8012024-11-14T16:52:35.657ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10686162021156357139 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
8022024-11-14T16:52:36.107ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13867837908407612504 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
8032024-11-14T16:52:36.107ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 234981320897751439 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
8042024-11-14T16:52:38.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4008716 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35836 req_id = 5c443cf8-0512-4cbe-a585-c0e4445de7ff response_code = 200 uri = /timesync
8052024-11-14T16:52:38.892ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731603156.6882646, correction: 0.043013588 } file = sled-agent/src/rack_setup/service.rs:740
8062024-11-14T16:52:38.892ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8072024-11-14T16:52:39.079ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8082024-11-14T16:52:39.080ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59724
8092024-11-14T16:52:39.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8837 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59724 req_id = 569b967e-04f4-4489-8f6e-a062ceaffa78 response_code = 200 uri = /timesync
8102024-11-14T16:52:39.092ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731603156.6882646, correction: 0.042474944 } file = sled-agent/src/rack_setup/service.rs:740
8112024-11-14T16:52:39.092ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8122024-11-14T16:52:39.405ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8132024-11-14T16:52:39.405ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55759
8142024-11-14T16:52:39.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55759 req_id = 994043d2-1c64-498d-8e48-c1780e42a97a response_code = 200 uri = /timesync
8152024-11-14T16:52:39.416ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731603156.6882646, correction: 0.041594878 } file = sled-agent/src/rack_setup/service.rs:740
8162024-11-14T16:52:39.416ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8172024-11-14T16:52:39.887ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8182024-11-14T16:52:39.887ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57886
8192024-11-14T16:52:39.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8784 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57886 req_id = bb51fd6f-cc15-4ec7-a81d-059775120ca3 response_code = 200 uri = /timesync
8202024-11-14T16:52:39.898ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731603156.6882646, correction: 0.051443532 } file = sled-agent/src/rack_setup/service.rs:740
8212024-11-14T16:52:39.898ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8222024-11-14T16:52:40.174ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15060625788421596292 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
8232024-11-14T16:52:40.175ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15522320868929196300 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
8242024-11-14T16:52:40.271ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8252024-11-14T16:52:40.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47235
8262024-11-14T16:52:40.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7963 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47235 req_id = 179eabb9-f27e-4316-8b8d-4fff7b3eaa92 response_code = 200 uri = /timesync
8272024-11-14T16:52:40.283ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731603156.6882646, correction: 0.04878249 } file = sled-agent/src/rack_setup/service.rs:740
8282024-11-14T16:52:40.283ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8292024-11-14T16:52:40.677ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8302024-11-14T16:52:40.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43136
8312024-11-14T16:52:40.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8969 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43136 req_id = 54603729-ee37-428c-a935-20240f8da0c1 response_code = 200 uri = /timesync
8322024-11-14T16:52:40.688ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731603156.6882646, correction: 0.047683436 } file = sled-agent/src/rack_setup/service.rs:740
8332024-11-14T16:52:40.688ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8342024-11-14T16:52:41.219ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8352024-11-14T16:52:41.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41891
8362024-11-14T16:52:41.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21443 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41891 req_id = eb7611e4-46d0-4b16-b7e3-78f4897d7ce7 response_code = 200 uri = /timesync
8372024-11-14T16:52:41.246ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1163513699, ip_addr: 69.89.207.99, stratum: 2, ref_time: 1731603160.9199915, correction: 0.045765396 } file = sled-agent/src/rack_setup/service.rs:740
8382024-11-14T16:52:41.246ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1425
8392024-11-14T16:52:41.276ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 89b01be2-c37f-445d-addd-6b4be9cd73c2 (service), filesystem_pool: Some(ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: bc5fdca1-6d92-4ff4-b5ae-2f44553a2186 (service), filesystem_pool: Some(ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: c3fb510c-8c5c-4a83-b5d7-4e199ba14057 (service), filesystem_pool: Some(ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 322bbd3c-708a-4aa9-b0e5-71bef219bdc2 (service), filesystem_pool: Some(ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 4c470dad-04c1-4a2e-b885-22e9e25a1515, kind: Service { id: 322bbd3c-708a-4aa9-b0e5-71bef219bdc2 }, name: Name("ntp-322bbd3c-708a-4aa9-b0e5-71bef219bdc2"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 197])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 19a1b81d-d3d4-4822-9259-477bb2e97c6a (service), filesystem_pool: Some(ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0bcdfcca-b1d5-4eff-b95c-68fc86a07272 (service), filesystem_pool: Some(ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External } } } }, OmicronZoneConfig { id: c44e611e-23ba-44be-a5ed-2c89466f4b3f (service), filesystem_pool: Some(ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External } } } }, OmicronZoneConfig { id: ba82210c-1e29-4838-a6e8-107eaa046495 (service), filesystem_pool: Some(ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External } } } }, OmicronZoneConfig { id: 43b3cc0f-740c-4fce-80a6-e7841d2c19c8 (service), filesystem_pool: Some(ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
8402024-11-14T16:52:41.276ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34950
8412024-11-14T16:52:41.277ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 89b01be2-c37f-445d-addd-6b4be9cd73c2, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8422024-11-14T16:52:41.277ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 89b01be2-c37f-445d-addd-6b4be9cd73c2, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8432024-11-14T16:52:41.311ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bc5fdca1-6d92-4ff4-b5ae-2f44553a2186, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8442024-11-14T16:52:41.311ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: bc5fdca1-6d92-4ff4-b5ae-2f44553a2186, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8452024-11-14T16:52:41.343ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c3fb510c-8c5c-4a83-b5d7-4e199ba14057, dataset_name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8462024-11-14T16:52:41.343ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c3fb510c-8c5c-4a83-b5d7-4e199ba14057, dataset_name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: InternalDns }, responder: ... }
8472024-11-14T16:52:41.375ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 19a1b81d-d3d4-4822-9259-477bb2e97c6a, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8482024-11-14T16:52:41.375ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 19a1b81d-d3d4-4822-9259-477bb2e97c6a, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8492024-11-14T16:52:41.407ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0bcdfcca-b1d5-4eff-b95c-68fc86a07272, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8502024-11-14T16:52:41.407ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0bcdfcca-b1d5-4eff-b95c-68fc86a07272, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8512024-11-14T16:52:41.439ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c44e611e-23ba-44be-a5ed-2c89466f4b3f, dataset_name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8522024-11-14T16:52:41.439ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c44e611e-23ba-44be-a5ed-2c89466f4b3f, dataset_name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: Cockroach }, responder: ... }
8532024-11-14T16:52:41.473ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ba82210c-1e29-4838-a6e8-107eaa046495, dataset_name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8542024-11-14T16:52:41.473ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ba82210c-1e29-4838-a6e8-107eaa046495, dataset_name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: Cockroach }, responder: ... }
8552024-11-14T16:52:41.504ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 43b3cc0f-740c-4fce-80a6-e7841d2c19c8, dataset_name: DatasetName { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8562024-11-14T16:52:41.504ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 43b3cc0f-740c-4fce-80a6-e7841d2c19c8, dataset_name: DatasetName { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8572024-11-14T16:52:41.537ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8582024-11-14T16:52:41.537ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/omicron-zones.json file = common/src/ledger.rs:177
8592024-11-14T16:52:41.538ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/omicron-zones.json file = common/src/ledger.rs:177
8602024-11-14T16:52:41.538ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8612024-11-14T16:52:41.570ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3314 zone = oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8
8622024-11-14T16:52:41.570ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3314 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
8632024-11-14T16:52:41.570ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3314 zone = oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f
8642024-11-14T16:52:41.570ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3314 zone = oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a
8652024-11-14T16:52:41.570ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3314 zone = oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495
8662024-11-14T16:52:41.570ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8", TimeNotSynchronized), ("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272", TimeNotSynchronized), ("oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f", TimeNotSynchronized), ("oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a", TimeNotSynchronized), ("oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495", TimeNotSynchronized)] file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 292907 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:34950 req_id = 3c53bdbe-ae24-4903-a8ca-1639575e3626 response_code = 500 uri = /omicron-zones
8672024-11-14T16:52:41.570ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3c53bdbe-ae24-4903-a8ca-1639575e3626", "content-length": "124", "date": "Thu, 14 Nov 2024 16:52:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3c53bdbe-ae24-4903-a8ca-1639575e3626" } file = sled-agent/src/rack_setup/service.rs:575 retry_after = 74.866558ms sled_address = [fd00:1122:3344:101::1]:12345
8682024-11-14T16:52:41.647ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 89b01be2-c37f-445d-addd-6b4be9cd73c2 (service), filesystem_pool: Some(ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: bc5fdca1-6d92-4ff4-b5ae-2f44553a2186 (service), filesystem_pool: Some(ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: c3fb510c-8c5c-4a83-b5d7-4e199ba14057 (service), filesystem_pool: Some(ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 322bbd3c-708a-4aa9-b0e5-71bef219bdc2 (service), filesystem_pool: Some(ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 4c470dad-04c1-4a2e-b885-22e9e25a1515, kind: Service { id: 322bbd3c-708a-4aa9-b0e5-71bef219bdc2 }, name: Name("ntp-322bbd3c-708a-4aa9-b0e5-71bef219bdc2"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 197])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 19a1b81d-d3d4-4822-9259-477bb2e97c6a (service), filesystem_pool: Some(ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0bcdfcca-b1d5-4eff-b95c-68fc86a07272 (service), filesystem_pool: Some(ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External } } } }, OmicronZoneConfig { id: c44e611e-23ba-44be-a5ed-2c89466f4b3f (service), filesystem_pool: Some(ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External } } } }, OmicronZoneConfig { id: ba82210c-1e29-4838-a6e8-107eaa046495 (service), filesystem_pool: Some(ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External } } } }, OmicronZoneConfig { id: 43b3cc0f-740c-4fce-80a6-e7841d2c19c8 (service), filesystem_pool: Some(ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
8692024-11-14T16:52:41.647ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 89b01be2-c37f-445d-addd-6b4be9cd73c2, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8702024-11-14T16:52:41.647ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 89b01be2-c37f-445d-addd-6b4be9cd73c2, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8712024-11-14T16:52:41.681ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bc5fdca1-6d92-4ff4-b5ae-2f44553a2186, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8722024-11-14T16:52:41.681ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: bc5fdca1-6d92-4ff4-b5ae-2f44553a2186, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8732024-11-14T16:52:41.713ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c3fb510c-8c5c-4a83-b5d7-4e199ba14057, dataset_name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8742024-11-14T16:52:41.713ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c3fb510c-8c5c-4a83-b5d7-4e199ba14057, dataset_name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: InternalDns }, responder: ... }
8752024-11-14T16:52:41.743ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 19a1b81d-d3d4-4822-9259-477bb2e97c6a, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8762024-11-14T16:52:41.743ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 19a1b81d-d3d4-4822-9259-477bb2e97c6a, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8772024-11-14T16:52:41.775ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0bcdfcca-b1d5-4eff-b95c-68fc86a07272, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8782024-11-14T16:52:41.775ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0bcdfcca-b1d5-4eff-b95c-68fc86a07272, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8792024-11-14T16:52:41.806ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c44e611e-23ba-44be-a5ed-2c89466f4b3f, dataset_name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8802024-11-14T16:52:41.806ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c44e611e-23ba-44be-a5ed-2c89466f4b3f, dataset_name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: Cockroach }, responder: ... }
8812024-11-14T16:52:41.839ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ba82210c-1e29-4838-a6e8-107eaa046495, dataset_name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8822024-11-14T16:52:41.839ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ba82210c-1e29-4838-a6e8-107eaa046495, dataset_name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: Cockroach }, responder: ... }
8832024-11-14T16:52:41.871ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 43b3cc0f-740c-4fce-80a6-e7841d2c19c8, dataset_name: DatasetName { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8842024-11-14T16:52:41.871ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 43b3cc0f-740c-4fce-80a6-e7841d2c19c8, dataset_name: DatasetName { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8852024-11-14T16:52:41.905ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8862024-11-14T16:52:41.905ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/omicron-zones.json file = common/src/ledger.rs:177
8872024-11-14T16:52:41.905ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/omicron-zones.json file = common/src/ledger.rs:177
8882024-11-14T16:52:41.905ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8892024-11-14T16:52:41.938ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3314 zone = oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8
8902024-11-14T16:52:41.938ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3314 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
8912024-11-14T16:52:41.938ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3314 zone = oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495
8922024-11-14T16:52:41.938ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3314 zone = oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a
8932024-11-14T16:52:41.938ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3314 zone = oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f
8942024-11-14T16:52:41.938ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8", TimeNotSynchronized), ("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272", TimeNotSynchronized), ("oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495", TimeNotSynchronized), ("oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a", TimeNotSynchronized), ("oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f", TimeNotSynchronized)] file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 290366 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:34950 req_id = 8402799c-a8b6-41b4-b82e-de6197cc7e6f response_code = 500 uri = /omicron-zones
8952024-11-14T16:52:41.938ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8402799c-a8b6-41b4-b82e-de6197cc7e6f", "content-length": "124", "date": "Thu, 14 Nov 2024 16:52:41 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8402799c-a8b6-41b4-b82e-de6197cc7e6f" } file = sled-agent/src/rack_setup/service.rs:575 retry_after = 80.358564ms sled_address = [fd00:1122:3344:101::1]:12345
8962024-11-14T16:52:42.020ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 89b01be2-c37f-445d-addd-6b4be9cd73c2 (service), filesystem_pool: Some(ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: bc5fdca1-6d92-4ff4-b5ae-2f44553a2186 (service), filesystem_pool: Some(ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: c3fb510c-8c5c-4a83-b5d7-4e199ba14057 (service), filesystem_pool: Some(ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 322bbd3c-708a-4aa9-b0e5-71bef219bdc2 (service), filesystem_pool: Some(ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 4c470dad-04c1-4a2e-b885-22e9e25a1515, kind: Service { id: 322bbd3c-708a-4aa9-b0e5-71bef219bdc2 }, name: Name("ntp-322bbd3c-708a-4aa9-b0e5-71bef219bdc2"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 197])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 19a1b81d-d3d4-4822-9259-477bb2e97c6a (service), filesystem_pool: Some(ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0bcdfcca-b1d5-4eff-b95c-68fc86a07272 (service), filesystem_pool: Some(ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External } } } }, OmicronZoneConfig { id: c44e611e-23ba-44be-a5ed-2c89466f4b3f (service), filesystem_pool: Some(ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External } } } }, OmicronZoneConfig { id: ba82210c-1e29-4838-a6e8-107eaa046495 (service), filesystem_pool: Some(ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External } } } }, OmicronZoneConfig { id: 43b3cc0f-740c-4fce-80a6-e7841d2c19c8 (service), filesystem_pool: Some(ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
8972024-11-14T16:52:42.020ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 89b01be2-c37f-445d-addd-6b4be9cd73c2, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8982024-11-14T16:52:42.020ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 89b01be2-c37f-445d-addd-6b4be9cd73c2, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8992024-11-14T16:52:42.055ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bc5fdca1-6d92-4ff4-b5ae-2f44553a2186, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
9002024-11-14T16:52:42.055ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: bc5fdca1-6d92-4ff4-b5ae-2f44553a2186, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9012024-11-14T16:52:42.087ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c3fb510c-8c5c-4a83-b5d7-4e199ba14057, dataset_name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
9022024-11-14T16:52:42.087ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c3fb510c-8c5c-4a83-b5d7-4e199ba14057, dataset_name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: InternalDns }, responder: ... }
9032024-11-14T16:52:42.120ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 19a1b81d-d3d4-4822-9259-477bb2e97c6a, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
9042024-11-14T16:52:42.120ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 19a1b81d-d3d4-4822-9259-477bb2e97c6a, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9052024-11-14T16:52:42.153ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0bcdfcca-b1d5-4eff-b95c-68fc86a07272, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
9062024-11-14T16:52:42.153ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0bcdfcca-b1d5-4eff-b95c-68fc86a07272, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9072024-11-14T16:52:42.186ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c44e611e-23ba-44be-a5ed-2c89466f4b3f, dataset_name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
9082024-11-14T16:52:42.186ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c44e611e-23ba-44be-a5ed-2c89466f4b3f, dataset_name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: Cockroach }, responder: ... }
9092024-11-14T16:52:42.218ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ba82210c-1e29-4838-a6e8-107eaa046495, dataset_name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
9102024-11-14T16:52:42.218ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ba82210c-1e29-4838-a6e8-107eaa046495, dataset_name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: Cockroach }, responder: ... }
9112024-11-14T16:52:42.250ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 43b3cc0f-740c-4fce-80a6-e7841d2c19c8, dataset_name: DatasetName { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
9122024-11-14T16:52:42.250ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 43b3cc0f-740c-4fce-80a6-e7841d2c19c8, dataset_name: DatasetName { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9132024-11-14T16:52:42.282ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9142024-11-14T16:52:42.282ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/omicron-zones.json file = common/src/ledger.rs:177
9152024-11-14T16:52:42.282ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/omicron-zones.json file = common/src/ledger.rs:177
9162024-11-14T16:52:42.282ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9172024-11-14T16:52:42.367ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9182024-11-14T16:52:42.367ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9192024-11-14T16:52:42.367ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9202024-11-14T16:52:42.367ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9212024-11-14T16:52:42.367ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
9222024-11-14T16:52:42.456ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f file = illumos-utils/src/zone.rs:325
9232024-11-14T16:52:42.460ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8 file = illumos-utils/src/zone.rs:325
9242024-11-14T16:52:42.464ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a file = illumos-utils/src/zone.rs:325
9252024-11-14T16:52:42.468ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495 file = illumos-utils/src/zone.rs:325
9262024-11-14T16:52:42.473ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272 file = illumos-utils/src/zone.rs:325
9272024-11-14T16:52:42.478ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f file = illumos-utils/src/zone.rs:363
9282024-11-14T16:52:42.482ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8 file = illumos-utils/src/zone.rs:363
9292024-11-14T16:52:42.487ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a file = illumos-utils/src/zone.rs:363
9302024-11-14T16:52:42.491ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495 file = illumos-utils/src/zone.rs:363
9312024-11-14T16:52:42.495ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272 file = illumos-utils/src/zone.rs:363
9322024-11-14T16:52:42.939ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 256.614314ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
9332024-11-14T16:52:44.703ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39066
9342024-11-14T16:52:44.703ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39066 req_id = 7e45aacf-5c98-4169-a2da-f1412daeb3a3 response_code = 200 uri = /baseboard
9352024-11-14T16:52:45.526ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='c44e611e-23ba-44be-a5ed-2c89466f4b3f'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9362024-11-14T16:52:45.526ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f
9372024-11-14T16:52:45.562ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='0bcdfcca-b1d5-4eff-b95c-68fc86a07272'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9382024-11-14T16:52:45.562ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
9392024-11-14T16:52:45.568ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='19a1b81d-d3d4-4822-9259-477bb2e97c6a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9402024-11-14T16:52:45.568ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ba82210c-1e29-4838-a6e8-107eaa046495'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9412024-11-14T16:52:45.568ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a
9422024-11-14T16:52:45.573ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495
9432024-11-14T16:52:45.581ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='43b3cc0f-740c-4fce-80a6-e7841d2c19c8'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9442024-11-14T16:52:45.581ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8
9452024-11-14T16:52:45.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f") failed: Property not found. retry in 72.313083ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f
9462024-11-14T16:52:45.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 42.129099ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
9472024-11-14T16:52:45.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a") failed: Property not found. retry in 40.534484ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a
9482024-11-14T16:52:45.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495") failed: Property not found. retry in 68.616081ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495
9492024-11-14T16:52:45.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8") failed: Property not found. retry in 44.722918ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8
9502024-11-14T16:52:45.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 145.238022ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
9512024-11-14T16:52:45.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f") failed: Property not found. retry in 145.234675ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f
9522024-11-14T16:52:46.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8") failed: Property not found. retry in 128.222666ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8
9532024-11-14T16:52:46.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a") failed: Property not found. retry in 149.033675ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a
9542024-11-14T16:52:46.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495") failed: Property not found. retry in 132.113ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495
9552024-11-14T16:52:47.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f") failed: Property not found. retry in 179.021946ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f
9562024-11-14T16:52:48.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8") failed: Property not found. retry in 257.113186ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8
9572024-11-14T16:52:48.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a") failed: Property not found. retry in 104.803114ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a
9582024-11-14T16:52:48.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495") failed: Property not found. retry in 127.776023ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495
9592024-11-14T16:52:48.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 216.573478ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
9602024-11-14T16:52:48.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f") failed: Property not found. retry in 316.617005ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f
9612024-11-14T16:52:48.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a") failed: Property not found. retry in 248.997819ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a
9622024-11-14T16:52:48.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8") failed: Property not found. retry in 589.092821ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8
9632024-11-14T16:52:48.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495") failed: Property not found. retry in 282.269566ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495
9642024-11-14T16:52:48.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 415.178081ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
9652024-11-14T16:52:48.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a") failed: Property not found. retry in 665.10429ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a
9662024-11-14T16:52:48.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f") failed: Property not found. retry in 683.946389ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f
9672024-11-14T16:52:48.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495") failed: Property not found. retry in 682.595031ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495
9682024-11-14T16:52:49.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 756.905ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
9692024-11-14T16:52:49.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8") failed: Property not found. retry in 885.385667ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8
9702024-11-14T16:52:49.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a") failed: Property not found. retry in 1.421181842s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a
9712024-11-14T16:52:49.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f") failed: Property not found. retry in 864.072172ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f
9722024-11-14T16:52:49.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495") failed: Property not found. retry in 1.460529883s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495
9732024-11-14T16:52:49.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 727.521873ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
9742024-11-14T16:52:50.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8") failed: Property not found. retry in 866.328455ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8
9752024-11-14T16:52:50.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f") failed: Property not found. retry in 909.627215ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f
9762024-11-14T16:52:50.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 919.929614ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
9772024-11-14T16:52:50.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a") failed: Property not found. retry in 1.339909872s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a
9782024-11-14T16:52:50.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8") failed: Property not found. retry in 1.172055819s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8
9792024-11-14T16:52:51.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495") failed: Property not found. retry in 1.121320557s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495
9802024-11-14T16:52:51.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f") failed: Property not found. retry in 1.021981756s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f
9812024-11-14T16:52:51.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 1.228005599s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
9822024-11-14T16:52:52.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8") failed: Property not found. retry in 673.460203ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8
9832024-11-14T16:52:52.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495") failed: Property not found. retry in 871.383548ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495
9842024-11-14T16:52:52.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a") failed: Property not found. retry in 1.22519932s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a
9852024-11-14T16:52:52.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f") failed: Property not found. retry in 1.251881346s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f
9862024-11-14T16:52:52.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8") failed: Property not found. retry in 1.216816285s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8
9872024-11-14T16:52:52.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 1.39229696s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
9882024-11-14T16:52:53.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495") failed: Property not found. retry in 1.120001976s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495
9892024-11-14T16:52:53.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a") failed: Property not found. retry in 1.21209287s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a
9902024-11-14T16:52:53.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f") failed: Property not found. retry in 1.481954181s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f
9912024-11-14T16:52:54.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8") failed: Property not found. retry in 1.087909283s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8
9922024-11-14T16:52:54.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495") failed: Property not found. retry in 1.256894942s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495
9932024-11-14T16:52:54.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 760.59552ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
9942024-11-14T16:52:54.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a") failed: Property not found. retry in 732.858075ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a
9952024-11-14T16:52:55.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 841.468239ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
9962024-11-14T16:52:55.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f") failed: Property not found. retry in 888.833123ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f
9972024-11-14T16:52:55.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8") failed: Property not found. retry in 510.724619ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8
9982024-11-14T16:52:55.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495") failed: Property not found. retry in 1.038919602s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495
9992024-11-14T16:52:55.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a") failed: Property not found. retry in 1.101905978s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a
10002024-11-14T16:52:55.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8") failed: Property not found. retry in 538.166592ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8
10012024-11-14T16:52:55.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 1.235561662s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
10022024-11-14T16:52:56.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f") failed: Property not found. retry in 1.047308435s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f
10032024-11-14T16:52:56.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8") failed: Property not found. retry in 627.783652ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8
10042024-11-14T16:52:56.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495") failed: Property not found. retry in 972.989812ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495
10052024-11-14T16:52:56.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a") failed: Property not found. retry in 1.487438886s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a
10062024-11-14T16:52:56.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8") failed: Property not found. retry in 1.449116228s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8
10072024-11-14T16:52:57.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f") failed: Property not found. retry in 1.279763761s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f
10082024-11-14T16:52:57.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 569.358853ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
10092024-11-14T16:52:57.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495") failed: Property not found. retry in 861.674546ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495
10102024-11-14T16:52:57.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 1.130084447s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
10112024-11-14T16:52:58.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a") failed: Property not found. retry in 956.076924ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a
10122024-11-14T16:52:58.265ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 586.546643ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
10132024-11-14T16:52:58.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8") failed: Property not found. retry in 738.103126ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8
10142024-11-14T16:52:58.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f") failed: Property not found. retry in 1.056360098s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f
10152024-11-14T16:52:58.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495") failed: Property not found. retry in 913.003283ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495
10162024-11-14T16:52:58.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 1.089598093s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
10172024-11-14T16:52:59.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8") failed: Property not found. retry in 1.484161361s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8
10182024-11-14T16:52:59.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a") failed: Property not found. retry in 819.624302ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a
10192024-11-14T16:52:59.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495") failed: Property not found. retry in 1.010947633s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495
10202024-11-14T16:52:59.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f") failed: Property not found. retry in 1.144937681s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f
10212024-11-14T16:52:59.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a") failed: Property not found. retry in 1.130340458s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a
10222024-11-14T16:52:59.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 956.732666ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
10232024-11-14T16:53:00.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495") failed: Property not found. retry in 1.443152789s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495
10242024-11-14T16:53:00.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8") failed: Property not found. retry in 1.166393709s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8
10252024-11-14T16:53:00.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f") failed: Property not found. retry in 1.056419204s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f
10262024-11-14T16:53:00.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 1.474642987s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
10272024-11-14T16:53:01.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a") failed: Property not found. retry in 1.265783908s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a
10282024-11-14T16:53:02.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 843.710253ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
10292024-11-14T16:53:03.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 1.398950681s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
10302024-11-14T16:53:04.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 1.347535799s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
10312024-11-14T16:53:06.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 1.469109015s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
10322024-11-14T16:53:07.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 504.916561ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
10332024-11-14T16:53:08.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 684.671323ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
10342024-11-14T16:53:09.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 1.395499577s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
10352024-11-14T16:53:10.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 686.27837ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
10362024-11-14T16:53:11.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 1.490040891s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
10372024-11-14T16:53:12.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272") failed: Property not found. retry in 1.139411071s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
10382024-11-14T16:53:13.818ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_c44e611e-23ba-44be-a5ed-2c89466f4b3f
10392024-11-14T16:53:13.818ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_43b3cc0f-740c-4fce-80a6-e7841d2c19c8
10402024-11-14T16:53:13.818ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_19a1b81d-d3d4-4822-9259-477bb2e97c6a
10412024-11-14T16:53:13.818ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_ba82210c-1e29-4838-a6e8-107eaa046495
10422024-11-14T16:53:13.818ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272
10432024-11-14T16:53:13.818ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10442024-11-14T16:53:13.829ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10452024-11-14T16:53:13.891ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.021651192s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
10462024-11-14T16:53:14.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31983872 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:34950 req_id = dc98c5fd-ff11-4720-abe5-aa87c2ec4532 response_code = 204 uri = /omicron-zones
10472024-11-14T16:53:14.074ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45056
10482024-11-14T16:53:14.329ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 255522 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:45056 req_id = 7a2b74d8-8a6b-4abf-8483-d160e7c9b875 response_code = 500 uri = /cockroachdb
10492024-11-14T16:53:14.330ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7a2b74d8-8a6b-4abf-8483-d160e7c9b875", "content-length": "124", "date": "Thu, 14 Nov 2024 16:53:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7a2b74d8-8a6b-4abf-8483-d160e7c9b875" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 103.327746ms
10502024-11-14T16:53:14.477ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 42258 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:45056 req_id = 064989d8-ab55-4460-89f0-cd0bff2cdaeb response_code = 500 uri = /cockroachdb
10512024-11-14T16:53:14.477ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "064989d8-ab55-4460-89f0-cd0bff2cdaeb", "content-length": "124", "date": "Thu, 14 Nov 2024 16:53:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "064989d8-ab55-4460-89f0-cd0bff2cdaeb" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 95.753258ms
10522024-11-14T16:53:14.614ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 39836 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:45056 req_id = e1ef4954-8458-4e36-98b4-229a12547393 response_code = 500 uri = /cockroachdb
10532024-11-14T16:53:14.614ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e1ef4954-8458-4e36-98b4-229a12547393", "content-length": "124", "date": "Thu, 14 Nov 2024 16:53:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e1ef4954-8458-4e36-98b4-229a12547393" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 154.956993ms
10542024-11-14T16:53:14.813ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 42218 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:45056 req_id = 585f8ef0-3ff3-44bc-a4c7-3f33cb7d8330 response_code = 500 uri = /cockroachdb
10552024-11-14T16:53:14.813ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61861
10562024-11-14T16:53:14.813ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61861 req_id = 3b09e84b-2c00-485b-badc-d9e21bd8b0a6 response_code = 200 uri = /baseboard
10572024-11-14T16:53:14.813ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "585f8ef0-3ff3-44bc-a4c7-3f33cb7d8330", "content-length": "124", "date": "Thu, 14 Nov 2024 16:53:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "585f8ef0-3ff3-44bc-a4c7-3f33cb7d8330" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 98.516512ms
10582024-11-14T16:53:14.939ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26067 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:45056 req_id = 983f8507-2118-4d22-a3ea-dc769e75dc65 response_code = 500 uri = /cockroachdb
10592024-11-14T16:53:14.940ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "983f8507-2118-4d22-a3ea-dc769e75dc65", "content-length": "124", "date": "Thu, 14 Nov 2024 16:53:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "983f8507-2118-4d22-a3ea-dc769e75dc65" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 309.503311ms
10602024-11-14T16:53:15.279ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28797 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:45056 req_id = 33b75f83-ba14-4fe6-bb82-b9d4cabbfb7d response_code = 500 uri = /cockroachdb
10612024-11-14T16:53:15.279ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "33b75f83-ba14-4fe6-bb82-b9d4cabbfb7d", "content-length": "124", "date": "Thu, 14 Nov 2024 16:53:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "33b75f83-ba14-4fe6-bb82-b9d4cabbfb7d" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 159.547365ms
10622024-11-14T16:53:15.468ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27156 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:45056 req_id = 79509537-f9fa-4fd2-8773-9ab71348eba0 response_code = 500 uri = /cockroachdb
10632024-11-14T16:53:15.468ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "79509537-f9fa-4fd2-8773-9ab71348eba0", "content-length": "124", "date": "Thu, 14 Nov 2024 16:53:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "79509537-f9fa-4fd2-8773-9ab71348eba0" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 357.609202ms
10642024-11-14T16:53:15.854ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27255 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:45056 req_id = 065e43a5-8ba5-460d-9f1a-c208daa53788 response_code = 500 uri = /cockroachdb
10652024-11-14T16:53:15.854ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "065e43a5-8ba5-460d-9f1a-c208daa53788", "content-length": "124", "date": "Thu, 14 Nov 2024 16:53:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "065e43a5-8ba5-460d-9f1a-c208daa53788" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 416.604943ms
10662024-11-14T16:53:16.300ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28406 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:45056 req_id = 2d24f1d4-4304-447e-8cd5-f53f3a46e676 response_code = 500 uri = /cockroachdb
10672024-11-14T16:53:16.300ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2d24f1d4-4304-447e-8cd5-f53f3a46e676", "content-length": "124", "date": "Thu, 14 Nov 2024 16:53:16 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2d24f1d4-4304-447e-8cd5-f53f3a46e676" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 562.883752ms
10682024-11-14T16:53:16.892ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27280 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:45056 req_id = 80cf627e-70b2-4e25-ae33-78de1f5c1ffc response_code = 500 uri = /cockroachdb
10692024-11-14T16:53:16.892ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "80cf627e-70b2-4e25-ae33-78de1f5c1ffc", "content-length": "124", "date": "Thu, 14 Nov 2024 16:53:16 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "80cf627e-70b2-4e25-ae33-78de1f5c1ffc" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 518.694424ms
10702024-11-14T16:53:17.438ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27050 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:45056 req_id = c79379fb-955e-4364-85d8-e7d77cfe6702 response_code = 500 uri = /cockroachdb
10712024-11-14T16:53:17.439ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c79379fb-955e-4364-85d8-e7d77cfe6702", "content-length": "124", "date": "Thu, 14 Nov 2024 16:53:17 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c79379fb-955e-4364-85d8-e7d77cfe6702" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 528.65752ms
10722024-11-14T16:53:18.091ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 120719 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:45056 req_id = d8915ea5-1f64-43e5-aa8b-f7d3da9d8039 response_code = 500 uri = /cockroachdb
10732024-11-14T16:53:18.091ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d8915ea5-1f64-43e5-aa8b-f7d3da9d8039", "content-length": "124", "date": "Thu, 14 Nov 2024 16:53:17 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d8915ea5-1f64-43e5-aa8b-f7d3da9d8039" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 637.109266ms
10742024-11-14T16:53:18.758ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28545 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:45056 req_id = 4761e7f7-a953-49b3-87a6-0dfa41a4a61e response_code = 500 uri = /cockroachdb
10752024-11-14T16:53:18.759ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4761e7f7-a953-49b3-87a6-0dfa41a4a61e", "content-length": "124", "date": "Thu, 14 Nov 2024 16:53:18 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4761e7f7-a953-49b3-87a6-0dfa41a4a61e" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 1.047281287s
10762024-11-14T16:53:19.835ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28902 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:45056 req_id = 0804ade4-bab9-4036-b7c6-528e22eccc7f response_code = 500 uri = /cockroachdb
10772024-11-14T16:53:19.836ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0804ade4-bab9-4036-b7c6-528e22eccc7f", "content-length": "124", "date": "Thu, 14 Nov 2024 16:53:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0804ade4-bab9-4036-b7c6-528e22eccc7f" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 1.169720074s
10782024-11-14T16:53:21.033ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0bcdfcca-b1d5-4eff-b95c-68fc86a07272 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26828 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:45056 req_id = 4a6760a9-6736-4025-8ce8-db2792f992d2 response_code = 500 uri = /cockroachdb
10792024-11-14T16:53:21.034ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4a6760a9-6736-4025-8ce8-db2792f992d2", "content-length": "124", "date": "Thu, 14 Nov 2024 16:53:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4a6760a9-6736-4025-8ce8-db2792f992d2" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 1.156982862s
10802024-11-14T16:53:24.279ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::4]:32221 file = sled-agent/src/services.rs:3743
10812024-11-14T16:53:25.523ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
10822024-11-14T16:53:28.544ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
10832024-11-14T16:53:28.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6352554 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:45056 req_id = ae70ef0c-8b91-4acb-823b-391f56c7ee03 response_code = 204 uri = /cockroachdb
10842024-11-14T16:53:28.580ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 89b01be2-c37f-445d-addd-6b4be9cd73c2 (service), filesystem_pool: Some(ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: bc5fdca1-6d92-4ff4-b5ae-2f44553a2186 (service), filesystem_pool: Some(ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: c3fb510c-8c5c-4a83-b5d7-4e199ba14057 (service), filesystem_pool: Some(ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 322bbd3c-708a-4aa9-b0e5-71bef219bdc2 (service), filesystem_pool: Some(ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 4c470dad-04c1-4a2e-b885-22e9e25a1515, kind: Service { id: 322bbd3c-708a-4aa9-b0e5-71bef219bdc2 }, name: Name("ntp-322bbd3c-708a-4aa9-b0e5-71bef219bdc2"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 197])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 19a1b81d-d3d4-4822-9259-477bb2e97c6a (service), filesystem_pool: Some(ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0bcdfcca-b1d5-4eff-b95c-68fc86a07272 (service), filesystem_pool: Some(ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External } } } }, OmicronZoneConfig { id: c44e611e-23ba-44be-a5ed-2c89466f4b3f (service), filesystem_pool: Some(ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External } } } }, OmicronZoneConfig { id: ba82210c-1e29-4838-a6e8-107eaa046495 (service), filesystem_pool: Some(ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External } } } }, OmicronZoneConfig { id: 43b3cc0f-740c-4fce-80a6-e7841d2c19c8 (service), filesystem_pool: Some(ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External } } } }, OmicronZoneConfig { id: 94482e71-9503-4d09-b73f-615fbf343a2e (service), filesystem_pool: Some(ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 7e993830-3c47-4e8c-8d42-eec7a6d6efc3, kind: Service { id: 94482e71-9503-4d09-b73f-615fbf343a2e }, name: Name("external-dns-94482e71-9503-4d09-b73f-615fbf343a2e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: cb30b954-f678-488f-bf13-6a751f361b3f (service), filesystem_pool: Some(ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 50069af6-9491-4754-9535-843738a189a5, kind: Service { id: cb30b954-f678-488f-bf13-6a751f361b3f }, name: Name("external-dns-cb30b954-f678-488f-bf13-6a751f361b3f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 18])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 2b0034bc-df6c-49bf-ba55-680c74f1cd4c (service), filesystem_pool: Some(ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: e712bb0a-d063-491f-bbf4-5dc66991d2fe, kind: Service { id: 2b0034bc-df6c-49bf-ba55-680c74f1cd4c }, name: Name("nexus-2b0034bc-df6c-49bf-ba55-680c74f1cd4c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 214])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 0cc022d1-76d3-4a28-8e75-e8e958faa197 (service), filesystem_pool: Some(ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: bbccdcee-328d-46b4-80f2-6e0f18d211c8, kind: Service { id: 0cc022d1-76d3-4a28-8e75-e8e958faa197 }, name: Name("nexus-0cc022d1-76d3-4a28-8e75-e8e958faa197"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 39])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: ce02c1f9-750d-466c-8882-9fa4058550a9 (service), filesystem_pool: Some(ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 30bff459-835e-497d-90ea-b8f3054087c8, kind: Service { id: ce02c1f9-750d-466c-8882-9fa4058550a9 }, name: Name("nexus-ce02c1f9-750d-466c-8882-9fa4058550a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: eb1db522-cd7d-4b64-9412-796885aef8d2 (service), filesystem_pool: Some(ZpoolName { id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 30c26c11-5f4a-4daa-8137-18a8269ceab7 (service), filesystem_pool: Some(ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External } } } }, OmicronZoneConfig { id: d5f284dc-1b4b-4b6e-a968-541dc37e0101 (service), filesystem_pool: Some(ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 3d5ae6ad-a2ce-4438-abee-9d82ac2effb8 (service), filesystem_pool: Some(ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 0e501d07-1dcd-44b6-9209-8628d0f96561 (service), filesystem_pool: Some(ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 2e4aa651-4738-4aa7-b42f-f42b755aadeb (service), filesystem_pool: Some(ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0fc621f8-a2aa-4e31-a67c-b7171999690c (service), filesystem_pool: Some(ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External } } } }, OmicronZoneConfig { id: 04de6779-4866-4c0e-a4ff-e6ef8f935105 (service), filesystem_pool: Some(ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External } } } }, OmicronZoneConfig { id: 747e1ef3-0842-4c75-af24-222a28b29725 (service), filesystem_pool: Some(ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External } } } }, OmicronZoneConfig { id: ef374e25-22af-499b-bd8c-f5b3baa4b575 (service), filesystem_pool: Some(ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External } } } }, OmicronZoneConfig { id: e39635a8-abec-4fb7-9523-eed895ae0082 (service), filesystem_pool: Some(ZpoolName { id: 8fbbea6c-76df-4af7-a25f-3e2c165ad855 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8fbbea6c-76df-4af7-a25f-3e2c165ad855 (zpool), kind: External } } } }, OmicronZoneConfig { id: aae44ffe-3fcd-4938-965b-d73cce293740 (service), filesystem_pool: Some(ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External } } } }, OmicronZoneConfig { id: 9ecd9d71-7914-41a8-89de-3bcd0dff90a4 (service), filesystem_pool: Some(ZpoolName { id: f3390b76-1a47-437d-b003-6296b24d9932 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f3390b76-1a47-437d-b003-6296b24d9932 (zpool), kind: External } } } }, OmicronZoneConfig { id: 85ead635-2fcd-4b46-8db6-a04f740c55c6 (service), filesystem_pool: Some(ZpoolName { id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
10852024-11-14T16:53:28.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53941
10862024-11-14T16:53:28.580ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 89b01be2-c37f-445d-addd-6b4be9cd73c2, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10872024-11-14T16:53:28.580ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 89b01be2-c37f-445d-addd-6b4be9cd73c2, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10882024-11-14T16:53:28.632ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bc5fdca1-6d92-4ff4-b5ae-2f44553a2186, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10892024-11-14T16:53:28.632ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: bc5fdca1-6d92-4ff4-b5ae-2f44553a2186, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10902024-11-14T16:53:28.691ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c3fb510c-8c5c-4a83-b5d7-4e199ba14057, dataset_name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10912024-11-14T16:53:28.691ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c3fb510c-8c5c-4a83-b5d7-4e199ba14057, dataset_name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: InternalDns }, responder: ... }
10922024-11-14T16:53:28.740ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 19a1b81d-d3d4-4822-9259-477bb2e97c6a, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10932024-11-14T16:53:28.740ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 19a1b81d-d3d4-4822-9259-477bb2e97c6a, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10942024-11-14T16:53:28.787ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0bcdfcca-b1d5-4eff-b95c-68fc86a07272, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10952024-11-14T16:53:28.787ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0bcdfcca-b1d5-4eff-b95c-68fc86a07272, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10962024-11-14T16:53:28.833ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c44e611e-23ba-44be-a5ed-2c89466f4b3f, dataset_name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10972024-11-14T16:53:28.833ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c44e611e-23ba-44be-a5ed-2c89466f4b3f, dataset_name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: Cockroach }, responder: ... }
10982024-11-14T16:53:28.882ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ba82210c-1e29-4838-a6e8-107eaa046495, dataset_name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10992024-11-14T16:53:28.882ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ba82210c-1e29-4838-a6e8-107eaa046495, dataset_name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: Cockroach }, responder: ... }
11002024-11-14T16:53:28.942ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 43b3cc0f-740c-4fce-80a6-e7841d2c19c8, dataset_name: DatasetName { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11012024-11-14T16:53:28.942ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 43b3cc0f-740c-4fce-80a6-e7841d2c19c8, dataset_name: DatasetName { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11022024-11-14T16:53:28.991ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 94482e71-9503-4d09-b73f-615fbf343a2e, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11032024-11-14T16:53:28.991ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 94482e71-9503-4d09-b73f-615fbf343a2e, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11042024-11-14T16:53:29.039ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cb30b954-f678-488f-bf13-6a751f361b3f, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11052024-11-14T16:53:29.039ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: cb30b954-f678-488f-bf13-6a751f361b3f, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11062024-11-14T16:53:29.086ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 30c26c11-5f4a-4daa-8137-18a8269ceab7, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
11072024-11-14T16:53:29.086ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 30c26c11-5f4a-4daa-8137-18a8269ceab7, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
11082024-11-14T16:53:29.129ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2e4aa651-4738-4aa7-b42f-f42b755aadeb, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11092024-11-14T16:53:29.129ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 2e4aa651-4738-4aa7-b42f-f42b755aadeb, dataset_name: DatasetName { pool_name: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, kind: Crucible }, responder: ... }
11102024-11-14T16:53:29.173ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0fc621f8-a2aa-4e31-a67c-b7171999690c, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11112024-11-14T16:53:29.173ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0fc621f8-a2aa-4e31-a67c-b7171999690c, dataset_name: DatasetName { pool_name: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, kind: Crucible }, responder: ... }
11122024-11-14T16:53:29.217ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 04de6779-4866-4c0e-a4ff-e6ef8f935105, dataset_name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11132024-11-14T16:53:29.217ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 04de6779-4866-4c0e-a4ff-e6ef8f935105, dataset_name: DatasetName { pool_name: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, kind: Crucible }, responder: ... }
11142024-11-14T16:53:29.306ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 747e1ef3-0842-4c75-af24-222a28b29725, dataset_name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11152024-11-14T16:53:29.306ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 747e1ef3-0842-4c75-af24-222a28b29725, dataset_name: DatasetName { pool_name: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, kind: Crucible }, responder: ... }
11162024-11-14T16:53:29.361ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ef374e25-22af-499b-bd8c-f5b3baa4b575, dataset_name: DatasetName { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11172024-11-14T16:53:29.361ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ef374e25-22af-499b-bd8c-f5b3baa4b575, dataset_name: DatasetName { pool_name: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, kind: Crucible }, responder: ... }
11182024-11-14T16:53:29.411ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e39635a8-abec-4fb7-9523-eed895ae0082, dataset_name: DatasetName { pool_name: ZpoolName { id: 8fbbea6c-76df-4af7-a25f-3e2c165ad855 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11192024-11-14T16:53:29.411ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e39635a8-abec-4fb7-9523-eed895ae0082, dataset_name: DatasetName { pool_name: ZpoolName { id: 8fbbea6c-76df-4af7-a25f-3e2c165ad855 (zpool), kind: External }, kind: Crucible }, responder: ... }
11202024-11-14T16:53:29.458ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: aae44ffe-3fcd-4938-965b-d73cce293740, dataset_name: DatasetName { pool_name: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11212024-11-14T16:53:29.458ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: aae44ffe-3fcd-4938-965b-d73cce293740, dataset_name: DatasetName { pool_name: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }, kind: Crucible }, responder: ... }
11222024-11-14T16:53:29.502ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9ecd9d71-7914-41a8-89de-3bcd0dff90a4, dataset_name: DatasetName { pool_name: ZpoolName { id: f3390b76-1a47-437d-b003-6296b24d9932 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11232024-11-14T16:53:29.502ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 9ecd9d71-7914-41a8-89de-3bcd0dff90a4, dataset_name: DatasetName { pool_name: ZpoolName { id: f3390b76-1a47-437d-b003-6296b24d9932 (zpool), kind: External }, kind: Crucible }, responder: ... }
11242024-11-14T16:53:29.549ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 85ead635-2fcd-4b46-8db6-a04f740c55c6, dataset_name: DatasetName { pool_name: ZpoolName { id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11252024-11-14T16:53:29.549ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 85ead635-2fcd-4b46-8db6-a04f740c55c6, dataset_name: DatasetName { pool_name: ZpoolName { id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool), kind: External }, kind: Crucible }, responder: ... }
11262024-11-14T16:53:29.596ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11272024-11-14T16:53:29.596ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/omicron-zones.json file = common/src/ledger.rs:177
11282024-11-14T16:53:29.597ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/omicron-zones.json file = common/src/ledger.rs:177
11292024-11-14T16:53:29.597ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11302024-11-14T16:53:29.742ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11312024-11-14T16:53:29.742ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11322024-11-14T16:53:29.742ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11332024-11-14T16:53:29.742ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11342024-11-14T16:53:29.744ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11352024-11-14T16:53:29.781ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11362024-11-14T16:53:29.781ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11372024-11-14T16:53:29.781ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11382024-11-14T16:53:29.781ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11392024-11-14T16:53:29.781ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11402024-11-14T16:53:29.968ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11412024-11-14T16:53:29.968ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11422024-11-14T16:53:29.968ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11432024-11-14T16:53:29.977ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.013128111s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
11442024-11-14T16:53:29.981ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11452024-11-14T16:53:29.981ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11462024-11-14T16:53:29.994ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11472024-11-14T16:53:29.994ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11482024-11-14T16:53:30.007ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11492024-11-14T16:53:30.007ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11502024-11-14T16:53:30.007ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101 file = illumos-utils/src/zone.rs:325
11512024-11-14T16:53:30.012ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082 file = illumos-utils/src/zone.rs:325
11522024-11-14T16:53:30.018ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4 file = illumos-utils/src/zone.rs:325
11532024-11-14T16:53:30.024ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575 file = illumos-utils/src/zone.rs:325
11542024-11-14T16:53:30.029ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c file = illumos-utils/src/zone.rs:325
11552024-11-14T16:53:30.034ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740 file = illumos-utils/src/zone.rs:325
11562024-11-14T16:53:30.040ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8 file = illumos-utils/src/zone.rs:325
11572024-11-14T16:53:30.045ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561 file = illumos-utils/src/zone.rs:325
11582024-11-14T16:53:30.168ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101 file = illumos-utils/src/zone.rs:363
11592024-11-14T16:53:30.172ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082 file = illumos-utils/src/zone.rs:363
11602024-11-14T16:53:30.177ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4 file = illumos-utils/src/zone.rs:363
11612024-11-14T16:53:30.183ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575 file = illumos-utils/src/zone.rs:363
11622024-11-14T16:53:30.188ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c file = illumos-utils/src/zone.rs:363
11632024-11-14T16:53:30.193ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740 file = illumos-utils/src/zone.rs:363
11642024-11-14T16:53:30.197ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8 file = illumos-utils/src/zone.rs:363
11652024-11-14T16:53:30.201ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561 file = illumos-utils/src/zone.rs:363
11662024-11-14T16:53:30.206ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725 file = illumos-utils/src/zone.rs:325
11672024-11-14T16:53:30.212ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6 file = illumos-utils/src/zone.rs:325
11682024-11-14T16:53:30.219ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7 file = illumos-utils/src/zone.rs:325
11692024-11-14T16:53:30.225ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb file = illumos-utils/src/zone.rs:325
11702024-11-14T16:53:30.232ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2 file = illumos-utils/src/zone.rs:325
11712024-11-14T16:53:30.240ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105 file = illumos-utils/src/zone.rs:325
11722024-11-14T16:53:30.248ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725 file = illumos-utils/src/zone.rs:363
11732024-11-14T16:53:30.256ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6 file = illumos-utils/src/zone.rs:363
11742024-11-14T16:53:30.264ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7 file = illumos-utils/src/zone.rs:363
11752024-11-14T16:53:30.271ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb file = illumos-utils/src/zone.rs:363
11762024-11-14T16:53:30.279ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2 file = illumos-utils/src/zone.rs:363
11772024-11-14T16:53:30.288ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105 file = illumos-utils/src/zone.rs:363
11782024-11-14T16:53:30.353ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11792024-11-14T16:53:30.407ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11802024-11-14T16:53:30.463ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11812024-11-14T16:53:30.520ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11822024-11-14T16:53:30.576ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11832024-11-14T16:53:30.578ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11842024-11-14T16:53:30.578ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11852024-11-14T16:53:30.631ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 161, 65]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11862024-11-14T16:53:30.631ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11872024-11-14T16:53:30.633ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11882024-11-14T16:53:30.633ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11892024-11-14T16:53:30.687ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 192, 39]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11902024-11-14T16:53:30.687ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11912024-11-14T16:53:30.689ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11922024-11-14T16:53:30.689ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11932024-11-14T16:53:30.744ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 193, 18]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11942024-11-14T16:53:30.744ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11952024-11-14T16:53:30.745ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
11962024-11-14T16:53:30.745ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
11972024-11-14T16:53:30.747ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11982024-11-14T16:53:30.747ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11992024-11-14T16:53:30.801ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 198, 214]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12002024-11-14T16:53:30.801ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12012024-11-14T16:53:30.801ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
12022024-11-14T16:53:30.801ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
12032024-11-14T16:53:30.801ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
12042024-11-14T16:53:30.801ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
12052024-11-14T16:53:30.801ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
12062024-11-14T16:53:30.803ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12072024-11-14T16:53:30.806ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12082024-11-14T16:53:30.806ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12092024-11-14T16:53:30.861ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 165, 197]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12102024-11-14T16:53:30.861ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12112024-11-14T16:53:30.862ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
12122024-11-14T16:53:30.864ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
12132024-11-14T16:53:30.866ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12142024-11-14T16:53:30.866ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12152024-11-14T16:53:31.050ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f file = illumos-utils/src/zone.rs:325
12162024-11-14T16:53:31.062ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
12172024-11-14T16:53:31.062ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
12182024-11-14T16:53:31.063ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e file = illumos-utils/src/zone.rs:325
12192024-11-14T16:53:31.074ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197 file = illumos-utils/src/zone.rs:325
12202024-11-14T16:53:31.086ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
12212024-11-14T16:53:31.086ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
12222024-11-14T16:53:31.086ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
12232024-11-14T16:53:31.090ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12242024-11-14T16:53:31.135ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e file = illumos-utils/src/zone.rs:363
12252024-11-14T16:53:31.246ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197 file = illumos-utils/src/zone.rs:363
12262024-11-14T16:53:31.319ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f file = illumos-utils/src/zone.rs:363
12272024-11-14T16:53:31.327ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
12282024-11-14T16:53:31.337ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c file = illumos-utils/src/zone.rs:325
12292024-11-14T16:53:31.383ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12302024-11-14T16:53:31.448ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c file = illumos-utils/src/zone.rs:363
12312024-11-14T16:53:31.596ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9 file = illumos-utils/src/zone.rs:325
12322024-11-14T16:53:31.774ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9 file = illumos-utils/src/zone.rs:363
12332024-11-14T16:53:33.673ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8fbbea6c-76df-4af7-a25f-3e2c165ad855/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='dddecfd7-6301-451d-b163-ee2545b77882'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12342024-11-14T16:53:33.679ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e573afbb-ee4c-4f2d-9d08-b65b7fca29cf/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e8698876-33dc-4117-b38d-71c2caa2ea34'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12352024-11-14T16:53:33.679ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
12362024-11-14T16:53:34.143ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f3390b76-1a47-437d-b003-6296b24d9932/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='6bfda356-a8b5-43fa-8603-6f9e7bacb22c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12372024-11-14T16:53:34.143ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_63c85555-7e85-4f53-92b1-afc3cd212893/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='286d45c5-4c74-45b5-ac03-c9053ff7ed85'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12382024-11-14T16:53:34.143ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_0e37ddab-daec-4c38-a903-78b351e48433/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5ce60f96-0cb8-44b9-ab5b-450a3562a3a8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12392024-11-14T16:53:34.144ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ad871e3f-9a86-4a01-ac75-964bae58e4aa/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='99d1d345-6d9a-4a7f-916d-26dab0c69d96'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12402024-11-14T16:53:34.144ZINFOSledAgent (ServiceManager): Booting oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
12412024-11-14T16:53:40.159ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
12422024-11-14T16:53:40.850ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
12432024-11-14T16:53:40.945ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
12442024-11-14T16:53:40.963ZINFOSledAgent (ServiceManager): Booting oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
12452024-11-14T16:53:41.081ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12462024-11-14T16:53:41.096ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
12472024-11-14T16:53:41.613ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12482024-11-14T16:53:41.664ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12492024-11-14T16:53:41.748ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
12502024-11-14T16:53:41.773ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
12512024-11-14T16:53:42.013ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7035d0a2-19ba-40db-9607-7d28aa893d7e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12522024-11-14T16:53:42.015ZINFOSledAgent (ServiceManager): Booting oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
12532024-11-14T16:53:42.411ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a47fbfc2-afec-46c8-bc5a-f6c02b232d2e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='63ef3277-7c80-4969-be75-ae8f8594cede'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12542024-11-14T16:53:42.416ZINFOSledAgent (ServiceManager): Booting oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
12552024-11-14T16:53:42.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725") failed: Property not found. retry in 47.886534ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
12562024-11-14T16:53:42.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101") failed: Property not found. retry in 29.943067ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
12572024-11-14T16:53:42.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 49.760226ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
12582024-11-14T16:53:42.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 54.894378ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
12592024-11-14T16:53:42.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575") failed: Property not found. retry in 60.820133ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
12602024-11-14T16:53:42.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c") failed: Property not found. retry in 54.477242ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
12612024-11-14T16:53:42.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740") failed: Property not found. retry in 74.941301ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
12622024-11-14T16:53:42.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 48.386504ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
12632024-11-14T16:53:42.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101") failed: Property not found. retry in 69.663341ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
12642024-11-14T16:53:42.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 124.005562ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
12652024-11-14T16:53:42.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 108.813881ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
12662024-11-14T16:53:42.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575") failed: Property not found. retry in 132.322913ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
12672024-11-14T16:53:42.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c") failed: Property not found. retry in 124.621185ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
12682024-11-14T16:53:42.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740") failed: Property not found. retry in 139.927573ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
12692024-11-14T16:53:42.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 73.986717ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
12702024-11-14T16:53:42.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 56.741666ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
12712024-11-14T16:53:42.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725") failed: Property not found. retry in 149.748937ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
12722024-11-14T16:53:42.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 37.671072ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
12732024-11-14T16:53:42.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 53.37045ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
12742024-11-14T16:53:42.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101") failed: Property not found. retry in 115.176043ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
12752024-11-14T16:53:42.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 169.435894ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
12762024-11-14T16:53:42.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 101.281546ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
12772024-11-14T16:53:42.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575") failed: Property not found. retry in 239.367688ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
12782024-11-14T16:53:42.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c") failed: Property not found. retry in 237.904455ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
12792024-11-14T16:53:43.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740") failed: Property not found. retry in 218.018811ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
12802024-11-14T16:53:43.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 92.171926ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
12812024-11-14T16:53:43.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 239.115183ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
12822024-11-14T16:53:43.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725") failed: Property not found. retry in 282.678186ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
12832024-11-14T16:53:43.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 109.942804ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
12842024-11-14T16:53:43.257ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_da94b0fc-e114-4d62-8eee-1f3b839145a7/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='cb6e9220-1c28-487e-a6f4-d8a550f08fd9'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12852024-11-14T16:53:43.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 72.342667ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
12862024-11-14T16:53:43.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101") failed: Property not found. retry in 379.441944ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
12872024-11-14T16:53:43.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 540.75888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
12882024-11-14T16:53:43.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 319.147176ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
12892024-11-14T16:53:43.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575") failed: Property not found. retry in 487.706327ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
12902024-11-14T16:53:43.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c") failed: Property not found. retry in 483.465745ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
12912024-11-14T16:53:43.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740") failed: Property not found. retry in 393.047429ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
12922024-11-14T16:53:43.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 135.460405ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
12932024-11-14T16:53:43.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 206.726165ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
12942024-11-14T16:53:43.391ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb
12952024-11-14T16:53:43.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 123.976609ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
12962024-11-14T16:53:43.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 273.687569ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
12972024-11-14T16:53:43.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725") failed: Property not found. retry in 329.755758ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
12982024-11-14T16:53:43.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 433.597387ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
12992024-11-14T16:53:43.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 256.527039ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
13002024-11-14T16:53:43.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 503.304076ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
13012024-11-14T16:53:43.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 1.081412208s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
13022024-11-14T16:53:43.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb") failed: Property not found. retry in 54.7785ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb
13032024-11-14T16:53:43.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101") failed: Property not found. retry in 704.29699ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
13042024-11-14T16:53:43.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 596.028193ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
13052024-11-14T16:53:43.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb") failed: Property not found. retry in 143.750314ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb
13062024-11-14T16:53:43.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740") failed: Property not found. retry in 716.645124ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
13072024-11-14T16:53:43.782ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='eb1db522-cd7d-4b64-9412-796885aef8d2'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13082024-11-14T16:53:43.783ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2
13092024-11-14T16:53:43.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 914.418672ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
13102024-11-14T16:53:43.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575") failed: Property not found. retry in 925.665773ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
13112024-11-14T16:53:43.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c") failed: Property not found. retry in 865.394845ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
13122024-11-14T16:53:43.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725") failed: Property not found. retry in 536.786277ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
13132024-11-14T16:53:43.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 761.978807ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
13142024-11-14T16:53:44.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb") failed: Property not found. retry in 259.238559ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb
13152024-11-14T16:53:44.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 930.959015ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
13162024-11-14T16:53:44.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 479.900729ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
13172024-11-14T16:53:44.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb") failed: Property not found. retry in 304.665261ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb
13182024-11-14T16:53:44.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2") failed: Property not found. retry in 67.012123ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2
13192024-11-14T16:53:44.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 1.000454601s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
13202024-11-14T16:53:44.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2") failed: Property not found. retry in 87.38052ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2
13212024-11-14T16:53:44.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101") failed: Property not found. retry in 1.234783385s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
13222024-11-14T16:53:44.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725") failed: Property not found. retry in 1.396523091s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
13232024-11-14T16:53:44.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2") failed: Property not found. retry in 166.944695ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2
13242024-11-14T16:53:44.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740") failed: Property not found. retry in 1.176200446s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
13252024-11-14T16:53:44.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb") failed: Property not found. retry in 529.435359ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb
13262024-11-14T16:53:44.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 1.410764472s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
13272024-11-14T16:53:44.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 651.699348ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
13282024-11-14T16:53:44.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2") failed: Property not found. retry in 543.67867ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2
13292024-11-14T16:53:44.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c") failed: Property not found. retry in 974.914788ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
13302024-11-14T16:53:44.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 896.880956ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
13312024-11-14T16:53:44.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 678.109572ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
13322024-11-14T16:53:44.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575") failed: Property not found. retry in 1.402225922s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
13332024-11-14T16:53:44.842ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13342024-11-14T16:53:44.851ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e
13352024-11-14T16:53:44.862ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13362024-11-14T16:53:44.863ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f
13372024-11-14T16:53:44.992ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38498
13382024-11-14T16:53:45.055ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48476 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38498 req_id = 9a27b8e6-2d17-4e3d-a2d7-03793c4d279c response_code = 200 uri = /baseboard
13392024-11-14T16:53:45.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 927.57321ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
13402024-11-14T16:53:45.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e") failed: Property not found. retry in 63.670511ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e
13412024-11-14T16:53:45.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f") failed: Property not found. retry in 38.780943ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f
13422024-11-14T16:53:45.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb") failed: Property not found. retry in 809.310705ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb
13432024-11-14T16:53:45.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f") failed: Property not found. retry in 112.072792ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f
13442024-11-14T16:53:45.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e") failed: Property not found. retry in 87.282674ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e
13452024-11-14T16:53:45.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2") failed: Property not found. retry in 968.052155ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2
13462024-11-14T16:53:45.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e") failed: Property not found. retry in 110.802317ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e
13472024-11-14T16:53:45.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f") failed: Property not found. retry in 219.967764ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f
13482024-11-14T16:53:45.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 1.408342258s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
13492024-11-14T16:53:45.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 702.254991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
13502024-11-14T16:53:45.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e") failed: Property not found. retry in 202.734757ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e
13512024-11-14T16:53:45.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 1.418987383s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
13522024-11-14T16:53:45.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f") failed: Property not found. retry in 224.416403ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f
13532024-11-14T16:53:45.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e") failed: Property not found. retry in 986.528059ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e
13542024-11-14T16:53:45.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 875.894113ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
13552024-11-14T16:53:45.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101") failed: Property not found. retry in 1.344883956s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
13562024-11-14T16:53:45.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740") failed: Property not found. retry in 554.515559ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
13572024-11-14T16:53:45.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c") failed: Property not found. retry in 726.408913ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
13582024-11-14T16:53:45.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f") failed: Property not found. retry in 890.951096ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f
13592024-11-14T16:53:45.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725") failed: Property not found. retry in 806.672178ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
13602024-11-14T16:53:46.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb") failed: Property not found. retry in 649.5267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb
13612024-11-14T16:53:46.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 562.374666ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
13622024-11-14T16:53:46.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 1.144196867s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
13632024-11-14T16:53:46.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 1.337515829s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
13642024-11-14T16:53:47.877ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.71589292s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
13652024-11-14T16:53:47.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101") failed: Property not found. retry in 848.169271ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
13662024-11-14T16:53:47.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 1.354901057s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
13672024-11-14T16:53:47.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 983.12792ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
13682024-11-14T16:53:47.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e") failed: Property not found. retry in 877.285919ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e
13692024-11-14T16:53:47.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575") failed: Property not found. retry in 688.018618ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
13702024-11-14T16:53:47.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c") failed: Property not found. retry in 1.221089617s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
13712024-11-14T16:53:47.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740") failed: Property not found. retry in 1.056162185s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
13722024-11-14T16:53:47.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 803.753278ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
13732024-11-14T16:53:47.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 1.255762318s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
13742024-11-14T16:53:47.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725") failed: Property not found. retry in 971.405054ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
13752024-11-14T16:53:48.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 613.239844ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
13762024-11-14T16:53:48.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f") failed: Property not found. retry in 633.709039ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f
13772024-11-14T16:53:48.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb") failed: Property not found. retry in 783.479811ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb
13782024-11-14T16:53:48.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2") failed: Property not found. retry in 792.033115ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2
13792024-11-14T16:53:48.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 906.98443ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
13802024-11-14T16:53:48.186ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13812024-11-14T16:53:48.187ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13822024-11-14T16:53:48.187ZINFOSledAgent (ServiceManager): Booting oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9
13832024-11-14T16:53:48.195ZINFOSledAgent (ServiceManager): Booting oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c
13842024-11-14T16:53:48.404ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13852024-11-14T16:53:48.405ZINFOSledAgent (ServiceManager): Booting oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197
13862024-11-14T16:53:48.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9") failed: Property not found. retry in 30.687204ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9
13872024-11-14T16:53:48.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c") failed: Property not found. retry in 36.7308ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c
13882024-11-14T16:53:48.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9") failed: Property not found. retry in 106.537651ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9
13892024-11-14T16:53:48.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c") failed: Property not found. retry in 67.630028ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c
13902024-11-14T16:53:48.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c") failed: Property not found. retry in 223.819271ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c
13912024-11-14T16:53:48.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9") failed: Property not found. retry in 117.885902ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9
13922024-11-14T16:53:48.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197") failed: Property not found. retry in 57.505401ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197
13932024-11-14T16:53:48.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 669.624825ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
13942024-11-14T16:53:48.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575") failed: Property not found. retry in 824.476667ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
13952024-11-14T16:53:48.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f") failed: Property not found. retry in 1.392574886s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f
13962024-11-14T16:53:48.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197") failed: Property not found. retry in 98.986128ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197
13972024-11-14T16:53:48.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9") failed: Property not found. retry in 223.013522ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9
13982024-11-14T16:53:48.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101") failed: Property not found. retry in 863.117312ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
13992024-11-14T16:53:48.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 1.172516679s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
14002024-11-14T16:53:48.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197") failed: Property not found. retry in 244.629739ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197
14012024-11-14T16:53:48.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e") failed: Property not found. retry in 1.448073459s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e
14022024-11-14T16:53:48.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c") failed: Property not found. retry in 346.402553ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c
14032024-11-14T16:53:48.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb") failed: Property not found. retry in 749.966303ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb
14042024-11-14T16:53:48.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2") failed: Property not found. retry in 501.729532ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2
14052024-11-14T16:53:48.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 927.91356ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
14062024-11-14T16:53:48.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725") failed: Property not found. retry in 507.815468ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
14072024-11-14T16:53:48.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9") failed: Property not found. retry in 770.407961ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9
14082024-11-14T16:53:49.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 1.32233435s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
14092024-11-14T16:53:49.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740") failed: Property not found. retry in 1.392892997s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
14102024-11-14T16:53:49.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197") failed: Property not found. retry in 468.28717ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197
14112024-11-14T16:53:49.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c") failed: Property not found. retry in 1.26222729s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
14122024-11-14T16:53:49.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c") failed: Property not found. retry in 854.472072ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c
14132024-11-14T16:53:49.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 1.225603754s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
14142024-11-14T16:53:49.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 762.979799ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
14152024-11-14T16:53:49.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 1.071829096s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
14162024-11-14T16:53:49.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2") failed: Property not found. retry in 1.413238827s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2
14172024-11-14T16:53:49.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575") failed: Property not found. retry in 835.183011ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
14182024-11-14T16:53:49.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725") failed: Property not found. retry in 1.417991533s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
14192024-11-14T16:53:49.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197") failed: Property not found. retry in 554.052877ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197
14202024-11-14T16:53:49.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb") failed: Property not found. retry in 1.261975436s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb
14212024-11-14T16:53:49.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101") failed: Property not found. retry in 1.079038219s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
14222024-11-14T16:53:49.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9") failed: Property not found. retry in 1.369374294s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9
14232024-11-14T16:53:49.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 593.735264ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
14242024-11-14T16:53:49.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 545.662582ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
14252024-11-14T16:53:50.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 1.424035837s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
14262024-11-14T16:53:50.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c") failed: Property not found. retry in 1.100985719s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c
14272024-11-14T16:53:50.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f") failed: Property not found. retry in 1.255333613s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f
14282024-11-14T16:53:50.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197") failed: Property not found. retry in 626.335126ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197
14292024-11-14T16:53:50.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e") failed: Property not found. retry in 1.082903396s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e
14302024-11-14T16:53:50.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575") failed: Property not found. retry in 877.017573ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
14312024-11-14T16:53:50.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 582.5224ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
14322024-11-14T16:53:50.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 982.585288ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
14332024-11-14T16:53:50.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740") failed: Property not found. retry in 1.164710188s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
14342024-11-14T16:53:50.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 897.621815ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
14352024-11-14T16:53:50.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c") failed: Property not found. retry in 867.492255ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
14362024-11-14T16:53:50.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 1.492400869s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
14372024-11-14T16:53:50.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 1.145271446s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
14382024-11-14T16:53:51.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101") failed: Property not found. retry in 1.047300834s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
14392024-11-14T16:53:51.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 1.117391233s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
14402024-11-14T16:53:51.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 1.165164493s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
14412024-11-14T16:53:51.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e") failed: Property not found. retry in 603.286607ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e
14422024-11-14T16:53:51.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197") failed: Property not found. retry in 1.33981326s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197
14432024-11-14T16:53:51.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575") failed: Property not found. retry in 1.076168432s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
14442024-11-14T16:53:52.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c") failed: Property not found. retry in 1.146892405s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
14452024-11-14T16:53:52.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740") failed: Property not found. retry in 1.364344259s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
14462024-11-14T16:53:52.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 556.0799ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
14472024-11-14T16:53:52.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 1.010398s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
14482024-11-14T16:53:52.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725") failed: Property not found. retry in 845.875373ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
14492024-11-14T16:53:52.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 536.914153ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
14502024-11-14T16:53:52.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f") failed: Property not found. retry in 1.256055242s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f
14512024-11-14T16:53:52.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9") failed: Property not found. retry in 1.432427807s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9
14522024-11-14T16:53:52.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb") failed: Property not found. retry in 1.269735078s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb
14532024-11-14T16:53:52.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c") failed: Property not found. retry in 874.827696ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c
14542024-11-14T16:53:52.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2") failed: Property not found. retry in 904.097328ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2
14552024-11-14T16:53:52.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 1.348313266s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
14562024-11-14T16:53:52.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e") failed: Property not found. retry in 644.340012ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e
14572024-11-14T16:53:52.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 1.109798214s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
14582024-11-14T16:53:52.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101") failed: Property not found. retry in 1.165009024s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
14592024-11-14T16:53:52.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 592.534021ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
14602024-11-14T16:53:52.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 712.453712ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
14612024-11-14T16:53:52.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 562.433584ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
14622024-11-14T16:53:53.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575") failed: Property not found. retry in 908.376836ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
14632024-11-14T16:53:53.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725") failed: Property not found. retry in 1.025003336s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
14642024-11-14T16:53:53.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c") failed: Property not found. retry in 910.240596ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
14652024-11-14T16:53:53.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197") failed: Property not found. retry in 1.113557363s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197
14662024-11-14T16:53:53.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 1.082195621s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
14672024-11-14T16:53:53.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e") failed: Property not found. retry in 602.139785ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e
14682024-11-14T16:53:53.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 1.084319553s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
14692024-11-14T16:53:53.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c") failed: Property not found. retry in 1.101787505s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c
14702024-11-14T16:53:53.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740") failed: Property not found. retry in 601.736789ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
14712024-11-14T16:53:53.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2") failed: Property not found. retry in 942.672801ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2
14722024-11-14T16:53:53.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 567.112975ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
14732024-11-14T16:53:53.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 516.913069ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
14742024-11-14T16:53:53.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f") failed: Property not found. retry in 621.322568ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f
14752024-11-14T16:53:53.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb") failed: Property not found. retry in 1.114074263s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb
14762024-11-14T16:53:53.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9") failed: Property not found. retry in 913.650895ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9
14772024-11-14T16:53:53.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 1.068151898s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
14782024-11-14T16:53:54.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101") failed: Property not found. retry in 1.363545397s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
14792024-11-14T16:53:54.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575") failed: Property not found. retry in 1.437623329s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
14802024-11-14T16:53:54.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 1.2624679s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
14812024-11-14T16:53:54.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e") failed: Property not found. retry in 1.002338447s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e
14822024-11-14T16:53:54.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740") failed: Property not found. retry in 513.823342ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
14832024-11-14T16:53:54.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725") failed: Property not found. retry in 1.332873523s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
14842024-11-14T16:53:54.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 903.55095ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
14852024-11-14T16:53:54.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c") failed: Property not found. retry in 929.500087ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
14862024-11-14T16:53:54.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 1.075684115s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
14872024-11-14T16:53:54.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f") failed: Property not found. retry in 661.263221ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f
14882024-11-14T16:53:54.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197") failed: Property not found. retry in 1.053136912s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197
14892024-11-14T16:53:54.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 703.790319ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
14902024-11-14T16:53:54.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2") failed: Property not found. retry in 1.212450283s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2
14912024-11-14T16:53:54.555ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14922024-11-14T16:53:54.562ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7
14932024-11-14T16:53:54.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 500.323809ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
14942024-11-14T16:53:54.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c") failed: Property not found. retry in 503.872666ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c
14952024-11-14T16:53:54.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740") failed: Property not found. retry in 1.47361544s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
14962024-11-14T16:53:54.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9") failed: Property not found. retry in 530.600795ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9
14972024-11-14T16:53:54.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7") failed: Property not found. retry in 32.692077ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7
14982024-11-14T16:53:54.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7") failed: Property not found. retry in 62.693689ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7
14992024-11-14T16:53:54.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb") failed: Property not found. retry in 1.115443476s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb
15002024-11-14T16:53:54.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7") failed: Property not found. retry in 277.886784ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7
15012024-11-14T16:53:54.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 827.941831ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
15022024-11-14T16:53:54.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f") failed: Property not found. retry in 1.012176788s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f
15032024-11-14T16:53:55.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e") failed: Property not found. retry in 1.186237475s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e
15042024-11-14T16:53:55.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 675.349902ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
15052024-11-14T16:53:55.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 859.372075ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
15062024-11-14T16:53:55.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c") failed: Property not found. retry in 856.226035ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
15072024-11-14T16:53:55.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c") failed: Property not found. retry in 1.219692849s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c
15082024-11-14T16:53:55.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 543.909943ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
15092024-11-14T16:53:55.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7") failed: Property not found. retry in 257.640237ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7
15102024-11-14T16:53:55.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 524.899963ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
15112024-11-14T16:53:55.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 951.28155ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
15122024-11-14T16:53:55.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9") failed: Property not found. retry in 692.166226ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9
15132024-11-14T16:53:55.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101") failed: Property not found. retry in 768.785716ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
15142024-11-14T16:53:55.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575") failed: Property not found. retry in 550.141091ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
15152024-11-14T16:53:55.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7") failed: Property not found. retry in 822.627028ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7
15162024-11-14T16:53:55.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197") failed: Property not found. retry in 723.922593ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197
15172024-11-14T16:53:55.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725") failed: Property not found. retry in 1.244775277s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
15182024-11-14T16:53:55.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 1.362834214s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
15192024-11-14T16:53:55.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2") failed: Property not found. retry in 715.179358ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2
15202024-11-14T16:53:55.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 1.055012548s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
15212024-11-14T16:53:55.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 831.510188ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
15222024-11-14T16:53:55.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 620.063889ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
15232024-11-14T16:53:55.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 625.698556ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
15242024-11-14T16:53:56.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c") failed: Property not found. retry in 1.00137806s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
15252024-11-14T16:53:56.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f") failed: Property not found. retry in 660.515064ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f
15262024-11-14T16:53:56.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb") failed: Property not found. retry in 726.746278ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb
15272024-11-14T16:53:56.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575") failed: Property not found. retry in 1.186476747s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
15282024-11-14T16:53:56.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9") failed: Property not found. retry in 880.147172ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9
15292024-11-14T16:53:56.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101") failed: Property not found. retry in 684.17338ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
15302024-11-14T16:53:56.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740") failed: Property not found. retry in 746.992011ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
15312024-11-14T16:53:56.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197") failed: Property not found. retry in 1.069132394s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197
15322024-11-14T16:53:56.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e") failed: Property not found. retry in 770.432812ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e
15332024-11-14T16:53:56.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 1.32388274s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
15342024-11-14T16:53:56.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7") failed: Property not found. retry in 914.45169ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7
15352024-11-14T16:53:56.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c") failed: Property not found. retry in 755.894808ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c
15362024-11-14T16:53:56.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 559.047732ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
15372024-11-14T16:53:56.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2") failed: Property not found. retry in 1.387618256s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2
15382024-11-14T16:53:56.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 1.321404384s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
15392024-11-14T16:53:56.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 530.996914ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
15402024-11-14T16:53:56.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f") failed: Property not found. retry in 1.03538667s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f
15412024-11-14T16:53:56.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb") failed: Property not found. retry in 1.223991813s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb
15422024-11-14T16:53:56.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725") failed: Property not found. retry in 622.290339ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
15432024-11-14T16:53:56.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 636.213689ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
15442024-11-14T16:53:56.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101") failed: Property not found. retry in 1.208188792s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
15452024-11-14T16:53:56.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740") failed: Property not found. retry in 590.959103ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
15462024-11-14T16:53:56.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9") failed: Property not found. retry in 820.352276ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9
15472024-11-14T16:53:57.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c") failed: Property not found. retry in 1.023735126s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
15482024-11-14T16:53:57.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 1.08205116s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
15492024-11-14T16:53:57.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e") failed: Property not found. retry in 1.496301532s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e
15502024-11-14T16:53:57.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 656.459411ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
15512024-11-14T16:53:57.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c") failed: Property not found. retry in 1.436300728s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c
15522024-11-14T16:53:57.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 1.380801689s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
15532024-11-14T16:53:57.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7") failed: Property not found. retry in 537.811143ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7
15542024-11-14T16:53:57.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575") failed: Property not found. retry in 1.468357126s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
15552024-11-14T16:53:57.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197") failed: Property not found. retry in 1.431835425s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197
15562024-11-14T16:53:57.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725") failed: Property not found. retry in 739.114054ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
15572024-11-14T16:53:57.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 1.373280938s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
15582024-11-14T16:53:57.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740") failed: Property not found. retry in 1.166211348s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
15592024-11-14T16:53:57.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 569.871125ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
15602024-11-14T16:53:57.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f") failed: Property not found. retry in 1.12949504s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f
15612024-11-14T16:53:57.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9") failed: Property not found. retry in 548.549888ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9
15622024-11-14T16:53:57.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7") failed: Property not found. retry in 1.300769783s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7
15632024-11-14T16:53:57.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 632.788819ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
15642024-11-14T16:53:57.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2") failed: Property not found. retry in 561.858756ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2
15652024-11-14T16:53:57.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 1.357145927s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
15662024-11-14T16:53:57.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb") failed: Property not found. retry in 1.05654425s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb
15672024-11-14T16:53:58.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c") failed: Property not found. retry in 1.331190503s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
15682024-11-14T16:53:58.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101") failed: Property not found. retry in 599.154507ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
15692024-11-14T16:53:58.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 748.745294ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
15702024-11-14T16:53:58.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725") failed: Property not found. retry in 825.161333ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
15712024-11-14T16:53:58.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 1.411796833s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
15722024-11-14T16:53:58.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9") failed: Property not found. retry in 1.490507418s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9
15732024-11-14T16:53:58.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 513.930364ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
15742024-11-14T16:53:58.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2") failed: Property not found. retry in 1.295515151s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2
15752024-11-14T16:53:58.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e") failed: Property not found. retry in 1.301065596s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e
15762024-11-14T16:53:58.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 918.254491ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
15772024-11-14T16:53:58.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c") failed: Property not found. retry in 1.368939653s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c
15782024-11-14T16:53:58.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101") failed: Property not found. retry in 849.282015ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
15792024-11-14T16:53:58.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740") failed: Property not found. retry in 1.449232204s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
15802024-11-14T16:53:58.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575") failed: Property not found. retry in 852.471948ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
15812024-11-14T16:53:58.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197") failed: Property not found. retry in 845.856114ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197
15822024-11-14T16:53:58.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 1.226685427s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
15832024-11-14T16:53:58.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f") failed: Property not found. retry in 560.69799ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f
15842024-11-14T16:53:58.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 648.808355ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
15852024-11-14T16:53:58.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 848.922527ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
15862024-11-14T16:53:59.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725") failed: Property not found. retry in 663.621482ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
15872024-11-14T16:53:59.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb") failed: Property not found. retry in 825.435456ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb
15882024-11-14T16:53:59.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7") failed: Property not found. retry in 1.439826926s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7
15892024-11-14T16:53:59.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 984.97697ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
15902024-11-14T16:53:59.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c") failed: Property not found. retry in 1.303021901s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
15912024-11-14T16:53:59.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f") failed: Property not found. retry in 1.367281909s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f
15922024-11-14T16:53:59.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 1.092962637s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
15932024-11-14T16:53:59.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101") failed: Property not found. retry in 1.048261696s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
15942024-11-14T16:53:59.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 768.463958ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
15952024-11-14T16:53:59.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575") failed: Property not found. retry in 992.609008ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
15962024-11-14T16:53:59.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 1.042860574s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
15972024-11-14T16:53:59.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197") failed: Property not found. retry in 803.992308ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197
15982024-11-14T16:53:59.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725") failed: Property not found. retry in 1.152583501s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
15992024-11-14T16:53:59.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2") failed: Property not found. retry in 1.4308349s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2
16002024-11-14T16:53:59.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 1.000755464s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
16012024-11-14T16:53:59.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9") failed: Property not found. retry in 1.450825199s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9
16022024-11-14T16:53:59.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e") failed: Property not found. retry in 1.317947061s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e
16032024-11-14T16:53:59.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb") failed: Property not found. retry in 730.482469ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb
16042024-11-14T16:53:59.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c") failed: Property not found. retry in 1.202197517s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c
16052024-11-14T16:54:00.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 772.006147ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
16062024-11-14T16:54:00.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740") failed: Property not found. retry in 1.477364219s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
16072024-11-14T16:54:00.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 853.473948ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
16082024-11-14T16:54:00.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 949.943336ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
16092024-11-14T16:54:00.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197") failed: Property not found. retry in 1.018463356s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197
16102024-11-14T16:54:00.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7") failed: Property not found. retry in 1.389771887s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7
16112024-11-14T16:54:00.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575") failed: Property not found. retry in 963.190191ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
16122024-11-14T16:54:00.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101") failed: Property not found. retry in 1.28096961s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
16132024-11-14T16:54:00.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 880.133455ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
16142024-11-14T16:54:00.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb") failed: Property not found. retry in 1.022038459s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb
16152024-11-14T16:54:00.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 1.254568857s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
16162024-11-14T16:54:00.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c") failed: Property not found. retry in 1.441023558s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
16172024-11-14T16:54:00.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 1.344076655s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
16182024-11-14T16:54:00.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f") failed: Property not found. retry in 1.409673136s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f
16192024-11-14T16:54:00.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725") failed: Property not found. retry in 689.13321ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
16202024-11-14T16:54:00.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 1.068395754s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
16212024-11-14T16:54:01.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 977.312156ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
16222024-11-14T16:54:01.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e") failed: Property not found. retry in 1.151239158s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e
16232024-11-14T16:54:01.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c") failed: Property not found. retry in 1.145376394s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c
16242024-11-14T16:54:01.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2") failed: Property not found. retry in 1.028066218s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2
16252024-11-14T16:54:01.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9") failed: Property not found. retry in 898.015331ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9
16262024-11-14T16:54:01.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 557.180311ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
16272024-11-14T16:54:01.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197") failed: Property not found. retry in 1.053761689s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197
16282024-11-14T16:54:01.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 1.453997815s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
16292024-11-14T16:54:01.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725") failed: Property not found. retry in 1.317591193s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
16302024-11-14T16:54:01.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575") failed: Property not found. retry in 1.034103595s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
16312024-11-14T16:54:01.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740") failed: Property not found. retry in 1.306853511s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
16322024-11-14T16:54:01.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb") failed: Property not found. retry in 820.43545ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb
16332024-11-14T16:54:01.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 681.569571ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
16342024-11-14T16:54:01.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101") failed: Property not found. retry in 698.081989ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
16352024-11-14T16:54:01.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 1.381190587s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
16362024-11-14T16:54:01.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7") failed: Property not found. retry in 1.274593463s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7
16372024-11-14T16:54:01.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 1.259933311s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
16382024-11-14T16:54:02.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 1.005321881s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
16392024-11-14T16:54:02.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c") failed: Property not found. retry in 732.723367ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
16402024-11-14T16:54:02.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 1.39172424s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
16412024-11-14T16:54:02.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9") failed: Property not found. retry in 1.250737622s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9
16422024-11-14T16:54:02.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f") failed: Property not found. retry in 1.255027256s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f
16432024-11-14T16:54:02.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2") failed: Property not found. retry in 1.333604464s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2
16442024-11-14T16:54:02.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e") failed: Property not found. retry in 639.781955ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e
16452024-11-14T16:54:02.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c") failed: Property not found. retry in 882.98542ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c
16462024-11-14T16:54:02.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb") failed: Property not found. retry in 954.549874ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb
16472024-11-14T16:54:02.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197") failed: Property not found. retry in 901.539516ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197
16482024-11-14T16:54:02.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 656.579183ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
16492024-11-14T16:54:02.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101") failed: Property not found. retry in 1.3210052s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
16502024-11-14T16:54:02.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575") failed: Property not found. retry in 1.47983698s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
16512024-11-14T16:54:02.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725") failed: Property not found. retry in 1.092383746s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
16522024-11-14T16:54:02.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c") failed: Property not found. retry in 971.349454ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
16532024-11-14T16:54:02.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740") failed: Property not found. retry in 605.172203ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
16542024-11-14T16:54:02.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 1.191437232s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
16552024-11-14T16:54:03.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e") failed: Property not found. retry in 826.167703ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e
16562024-11-14T16:54:03.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 1.266864118s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
16572024-11-14T16:54:03.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7") failed: Property not found. retry in 698.049931ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7
16582024-11-14T16:54:03.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 1.418327998s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
16592024-11-14T16:54:03.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 508.649898ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
16602024-11-14T16:54:03.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c") failed: Property not found. retry in 817.850865ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c
16612024-11-14T16:54:03.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 1.025231167s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
16622024-11-14T16:54:03.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197") failed: Property not found. retry in 1.05158695s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197
16632024-11-14T16:54:03.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9") failed: Property not found. retry in 1.290458363s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9
16642024-11-14T16:54:03.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f") failed: Property not found. retry in 1.054477508s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f
16652024-11-14T16:54:03.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740") failed: Property not found. retry in 587.895705ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
16662024-11-14T16:54:03.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561") failed: Property not found. retry in 1.045283694s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
16672024-11-14T16:54:03.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2") failed: Property not found. retry in 531.177812ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2
16682024-11-14T16:54:03.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 728.832099ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
16692024-11-14T16:54:03.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e") failed: Property not found. retry in 1.232292616s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e
16702024-11-14T16:54:03.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c") failed: Property not found. retry in 1.21820747s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
16712024-11-14T16:54:03.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7") failed: Property not found. retry in 591.865379ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7
16722024-11-14T16:54:03.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101") failed: Property not found. retry in 611.067943ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
16732024-11-14T16:54:03.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725") failed: Property not found. retry in 1.448264921s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
16742024-11-14T16:54:04.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c") failed: Property not found. retry in 1.258434773s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c
16752024-11-14T16:54:04.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575") failed: Property not found. retry in 834.264431ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
16762024-11-14T16:54:04.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2") failed: Property not found. retry in 897.060033ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2
16772024-11-14T16:54:04.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740") failed: Property not found. retry in 1.08716624s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
16782024-11-14T16:54:04.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8") failed: Property not found. retry in 1.348307637s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
16792024-11-14T16:54:04.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4") failed: Property not found. retry in 1.473594501s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
16802024-11-14T16:54:04.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6") failed: Property not found. retry in 1.033788108s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
16812024-11-14T16:54:04.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082") failed: Property not found. retry in 946.093468ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
16822024-11-14T16:54:04.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197") failed: Property not found. retry in 711.372203ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197
16832024-11-14T16:54:04.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7") failed: Property not found. retry in 1.499129191s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7
16842024-11-14T16:54:04.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f") failed: Property not found. retry in 1.302766262s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f
16852024-11-14T16:54:04.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105") failed: Property not found. retry in 1.432830793s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
16862024-11-14T16:54:04.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9") failed: Property not found. retry in 837.382465ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9
16872024-11-14T16:54:04.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575") failed: Property not found. retry in 865.437076ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
16882024-11-14T16:54:05.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c") failed: Property not found. retry in 554.060275ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
16892024-11-14T16:54:06.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_d5f284dc-1b4b-4b6e-a968-541dc37e0101
16902024-11-14T16:54:06.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_e39635a8-abec-4fb7-9523-eed895ae0082
16912024-11-14T16:54:06.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_9ecd9d71-7914-41a8-89de-3bcd0dff90a4
16922024-11-14T16:54:06.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_94482e71-9503-4d09-b73f-615fbf343a2e
16932024-11-14T16:54:06.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_0cc022d1-76d3-4a28-8e75-e8e958faa197
16942024-11-14T16:54:06.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_ef374e25-22af-499b-bd8c-f5b3baa4b575
16952024-11-14T16:54:06.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_0fc621f8-a2aa-4e31-a67c-b7171999690c
16962024-11-14T16:54:06.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_aae44ffe-3fcd-4938-965b-d73cce293740
16972024-11-14T16:54:06.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_3d5ae6ad-a2ce-4438-abee-9d82ac2effb8
16982024-11-14T16:54:06.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_0e501d07-1dcd-44b6-9209-8628d0f96561
16992024-11-14T16:54:06.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_747e1ef3-0842-4c75-af24-222a28b29725
17002024-11-14T16:54:06.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_85ead635-2fcd-4b46-8db6-a04f740c55c6
17012024-11-14T16:54:06.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_cb30b954-f678-488f-bf13-6a751f361b3f
17022024-11-14T16:54:06.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_30c26c11-5f4a-4daa-8137-18a8269ceab7
17032024-11-14T16:54:06.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_ce02c1f9-750d-466c-8882-9fa4058550a9
17042024-11-14T16:54:06.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_2e4aa651-4738-4aa7-b42f-f42b755aadeb
17052024-11-14T16:54:06.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_2b0034bc-df6c-49bf-ba55-680c74f1cd4c
17062024-11-14T16:54:06.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_eb1db522-cd7d-4b64-9412-796885aef8d2
17072024-11-14T16:54:06.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_04de6779-4866-4c0e-a4ff-e6ef8f935105
17082024-11-14T16:54:06.220ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17092024-11-14T16:54:06.232ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17102024-11-14T16:54:06.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37667002 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53941 req_id = 2abea6a9-51d8-4545-834d-af63f03b86d8 response_code = 204 uri = /omicron-zones
17112024-11-14T16:54:06.296ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1448
17122024-11-14T16:54:06.296ZINFOSledAgent (RSS): Writing ledger to /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17132024-11-14T16:54:06.297ZINFOSledAgent (RSS): Writing ledger to /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17142024-11-14T16:54:06.566ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:787
17152024-11-14T16:54:06.571ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:799
17162024-11-14T16:54:06.682ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1013
17172024-11-14T16:54:06.696ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 9.598869616s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
17182024-11-14T16:54:08.780ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bea93e92-909d-49e0-be82-54bba0eec36c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17192024-11-14T16:54:08.862ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bea93e92-909d-49e0-be82-54bba0eec36c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17202024-11-14T16:54:08.983ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bea93e92-909d-49e0-be82-54bba0eec36c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17212024-11-14T16:54:09.189ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bea93e92-909d-49e0-be82-54bba0eec36c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17222024-11-14T16:54:09.312ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bea93e92-909d-49e0-be82-54bba0eec36c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17232024-11-14T16:54:09.534ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bea93e92-909d-49e0-be82-54bba0eec36c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17242024-11-14T16:54:09.715ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bea93e92-909d-49e0-be82-54bba0eec36c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17252024-11-14T16:54:10.034ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bea93e92-909d-49e0-be82-54bba0eec36c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17262024-11-14T16:54:10.222ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bea93e92-909d-49e0-be82-54bba0eec36c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17272024-11-14T16:54:10.776ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bea93e92-909d-49e0-be82-54bba0eec36c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17282024-11-14T16:54:11.233ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bea93e92-909d-49e0-be82-54bba0eec36c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17292024-11-14T16:54:11.691ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bea93e92-909d-49e0-be82-54bba0eec36c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17302024-11-14T16:54:12.220ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bea93e92-909d-49e0-be82-54bba0eec36c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17312024-11-14T16:54:12.819ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bea93e92-909d-49e0-be82-54bba0eec36c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17322024-11-14T16:54:13.417ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bea93e92-909d-49e0-be82-54bba0eec36c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17332024-11-14T16:54:15.115ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36070
17342024-11-14T16:54:15.120ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4508 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36070 req_id = 799131c1-7a68-4e36-8481-73e9708245af response_code = 200 uri = /baseboard
17352024-11-14T16:54:15.284ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "14ef3915-79e2-40a9-ac26-f27ebd3c46ed", "content-length": "173", "date": "Thu, 14 Nov 2024 16:54:15 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"bea93e92-909d-49e0-be82-54bba0eec36c\"", request_id: "14ef3915-79e2-40a9-ac26-f27ebd3c46ed" } file = sled-agent/src/rack_setup/service.rs:1075
17362024-11-14T16:54:16.223ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a5caaabe-2cbc-4716-9f32-a98e66bbf428", "content-length": "173", "date": "Thu, 14 Nov 2024 16:54:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"bea93e92-909d-49e0-be82-54bba0eec36c\"", request_id: "a5caaabe-2cbc-4716-9f32-a98e66bbf428" } file = sled-agent/src/rack_setup/service.rs:1075
17372024-11-14T16:54:16.396ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 15.364086517s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"138b7079-9df1-4750-90fa-121090e7878c\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Thu, 14 Nov 2024 16:54:16 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"138b7079-9df1-4750-90fa-121090e7878c\\" }" file = oximeter/producer/src/lib.rs:420 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
17382024-11-14T16:54:19.134ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0b91f1df-99c3-4287-acf7-6097849ab190", "content-length": "173", "date": "Thu, 14 Nov 2024 16:54:19 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"f70fbf74-7489-439f-8ec3-e6e8473a8b43\"", request_id: "0b91f1df-99c3-4287-acf7-6097849ab190" } file = sled-agent/src/rack_setup/service.rs:1075
17392024-11-14T16:54:22.987ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "2978d8a1-7fcc-4eb9-afe8-05f0cb883268", "content-length": "173", "date": "Thu, 14 Nov 2024 16:54:22 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"f70fbf74-7489-439f-8ec3-e6e8473a8b43\"", request_id: "2978d8a1-7fcc-4eb9-afe8-05f0cb883268" } file = sled-agent/src/rack_setup/service.rs:1075
17402024-11-14T16:54:25.024ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7dfc2a13-6d48-4a1d-bd37-2eb415b141b0", "content-length": "173", "date": "Thu, 14 Nov 2024 16:54:24 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"f70fbf74-7489-439f-8ec3-e6e8473a8b43\"", request_id: "7dfc2a13-6d48-4a1d-bd37-2eb415b141b0" } file = sled-agent/src/rack_setup/service.rs:1075
17412024-11-14T16:54:28.036ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "482cb66d-c32d-48a3-aa93-610d09dbbfd4", "content-length": "173", "date": "Thu, 14 Nov 2024 16:54:28 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"f70fbf74-7489-439f-8ec3-e6e8473a8b43\"", request_id: "482cb66d-c32d-48a3-aa93-610d09dbbfd4" } file = sled-agent/src/rack_setup/service.rs:1075
17422024-11-14T16:54:30.822ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7e33a00b-92f6-43ff-8bfe-0c6d10a2b5da", "content-length": "173", "date": "Thu, 14 Nov 2024 16:54:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"f70fbf74-7489-439f-8ec3-e6e8473a8b43\"", request_id: "7e33a00b-92f6-43ff-8bfe-0c6d10a2b5da" } file = sled-agent/src/rack_setup/service.rs:1075
17432024-11-14T16:54:37.131ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "86749206-2c59-4bf7-9983-5ff07e93c321", "content-length": "173", "date": "Thu, 14 Nov 2024 16:54:37 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"f70fbf74-7489-439f-8ec3-e6e8473a8b43\"", request_id: "86749206-2c59-4bf7-9983-5ff07e93c321" } file = sled-agent/src/rack_setup/service.rs:1075
17442024-11-14T16:54:40.395ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "fbbb4362-894e-4a16-8a7e-90710d4142ce", "content-length": "173", "date": "Thu, 14 Nov 2024 16:54:40 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"f70fbf74-7489-439f-8ec3-e6e8473a8b43\"", request_id: "fbbb4362-894e-4a16-8a7e-90710d4142ce" } file = sled-agent/src/rack_setup/service.rs:1075
17452024-11-14T16:54:41.922ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
17462024-11-14T16:54:42.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46684
17472024-11-14T16:54:42.016ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17482024-11-14T16:54:42.016ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17492024-11-14T16:54:42.017ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/omicron-zones.json file = common/src/ledger.rs:177
17502024-11-14T16:54:42.021ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/omicron-zones.json file = common/src/ledger.rs:177
17512024-11-14T16:54:42.034ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17522024-11-14T16:54:42.034ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da94b0fc-e114-4d62-8eee-1f3b839145a7
17532024-11-14T16:54:42.057ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17542024-11-14T16:54:42.057ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0e37ddab-daec-4c38-a903-78b351e48433
17552024-11-14T16:54:42.080ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17562024-11-14T16:54:42.080ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a47fbfc2-afec-46c8-bc5a-f6c02b232d2e
17572024-11-14T16:54:42.101ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17582024-11-14T16:54:42.101ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e573afbb-ee4c-4f2d-9d08-b65b7fca29cf
17592024-11-14T16:54:42.121ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17602024-11-14T16:54:42.121ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_63c85555-7e85-4f53-92b1-afc3cd212893
17612024-11-14T16:54:42.141ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8fbbea6c-76df-4af7-a25f-3e2c165ad855 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17622024-11-14T16:54:42.141ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8fbbea6c-76df-4af7-a25f-3e2c165ad855
17632024-11-14T16:54:42.160ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17642024-11-14T16:54:42.160ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad871e3f-9a86-4a01-ac75-964bae58e4aa
17652024-11-14T16:54:42.181ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f3390b76-1a47-437d-b003-6296b24d9932 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17662024-11-14T16:54:42.181ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f3390b76-1a47-437d-b003-6296b24d9932
17672024-11-14T16:54:42.200ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17682024-11-14T16:54:42.200ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c
17692024-11-14T16:54:42.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198558 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46684 req_id = baf1eb96-f091-47ea-9ac7-58bdb133ce7d response_code = 200 uri = /inventory
17702024-11-14T16:54:45.154ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47936
17712024-11-14T16:54:45.155ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47936 req_id = 4f55e05e-1474-4992-8fbb-52e22e7a37ad response_code = 200 uri = /baseboard
17722024-11-14T16:54:46.777ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:60350 remote_addr = [fd00:1122:3344:101::d]:36478 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
17732024-11-14T16:54:46.828ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49670 local_addr = [fd00:1122:3344:101::1]:60350 method = GET remote_addr = [fd00:1122:3344:101::d]:36478 req_id = f88ff1d9-678b-4445-9145-b76485e56676 response_code = 200 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 uri = /f70fbf74-7489-439f-8ec3-e6e8473a8b43
17742024-11-14T16:54:46.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61254
17752024-11-14T16:54:46.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 403 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61254 req_id = 1586baea-5302-4ba4-93a5-596b67ca5e4a response_code = 200 uri = /vpc-routes
17762024-11-14T16:54:47.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63361
17772024-11-14T16:54:47.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 504 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63361 req_id = 87d2d10c-7880-409c-89fe-7b0b178fdec7 response_code = 200 uri = /v2p
17782024-11-14T16:54:47.608ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
17792024-11-14T16:54:47.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 552 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61254 req_id = de1efc72-481a-4b82-bf6a-9d7022a92d8c response_code = 204 uri = /eip-gateways
17802024-11-14T16:54:47.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34707
17812024-11-14T16:54:47.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47953
17822024-11-14T16:54:47.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47953 req_id = 665b2067-db96-4866-9d3b-5fc1000f6eba response_code = 200 uri = /vpc-routes
17832024-11-14T16:54:47.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 607 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34707 req_id = 6f9aaf6c-1169-4249-8c89-bfd96c689c38 response_code = 200 uri = /v2p
17842024-11-14T16:54:47.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58769
17852024-11-14T16:54:47.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51078
17862024-11-14T16:54:47.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51078 req_id = cbdc4f19-fad2-4b4f-b1e9-5ab93c8db396 response_code = 200 uri = /vpc-routes
17872024-11-14T16:54:47.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58769 req_id = a0b474e0-cc7a-4e67-9f73-542a0873a4cf response_code = 200 uri = /v2p
17882024-11-14T16:54:47.647ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
17892024-11-14T16:54:47.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51078 req_id = 14e7049f-79f1-42a7-86f5-f0c5883b9323 response_code = 204 uri = /eip-gateways
17902024-11-14T16:54:47.667ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
17912024-11-14T16:54:47.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47953 req_id = 8f16aa62-cdff-44b7-b201-bd7f3fd0fbc5 response_code = 204 uri = /eip-gateways
17922024-11-14T16:54:47.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47953 req_id = c10d89ad-0ca4-4d9a-960b-ee9ce8934e1d response_code = 204 uri = /vpc-routes
17932024-11-14T16:54:47.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33703
17942024-11-14T16:54:47.891ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 50069af6-9491-4754-9535-843738a189a5, kind: Service { id: cb30b954-f678-488f-bf13-6a751f361b3f }, name: Name("external-dns-cb30b954-f678-488f-bf13-6a751f361b3f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 18])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e993830-3c47-4e8c-8d42-eec7a6d6efc3, kind: Service { id: 94482e71-9503-4d09-b73f-615fbf343a2e }, name: Name("external-dns-94482e71-9503-4d09-b73f-615fbf343a2e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 30bff459-835e-497d-90ea-b8f3054087c8, kind: Service { id: ce02c1f9-750d-466c-8882-9fa4058550a9 }, name: Name("nexus-ce02c1f9-750d-466c-8882-9fa4058550a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbccdcee-328d-46b4-80f2-6e0f18d211c8, kind: Service { id: 0cc022d1-76d3-4a28-8e75-e8e958faa197 }, name: Name("nexus-0cc022d1-76d3-4a28-8e75-e8e958faa197"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 39])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e712bb0a-d063-491f-bbf4-5dc66991d2fe, kind: Service { id: 2b0034bc-df6c-49bf-ba55-680c74f1cd4c }, name: Name("nexus-2b0034bc-df6c-49bf-ba55-680c74f1cd4c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 214])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17952024-11-14T16:54:47.891ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17962024-11-14T16:54:47.891ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
17972024-11-14T16:54:47.891ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17982024-11-14T16:54:47.891ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17992024-11-14T16:54:47.891ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18002024-11-14T16:54:47.891ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18012024-11-14T16:54:47.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33703 req_id = 64265b20-fe8b-4fdb-913d-dcd37d2de856 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18022024-11-14T16:54:47.893ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1085
18032024-11-14T16:54:47.898ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
18042024-11-14T16:54:47.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 723 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51078 req_id = eccb79bc-a14c-4591-930c-7504abbacb6c response_code = 204 uri = /vpc-routes
18052024-11-14T16:54:47.924ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
18062024-11-14T16:54:47.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61254 req_id = fddafcf0-4ad4-4747-bff8-f08a5a05acb0 response_code = 204 uri = /vpc-routes
18072024-11-14T16:54:48.016ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38338
18082024-11-14T16:54:48.017ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18092024-11-14T16:54:48.017ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18102024-11-14T16:54:48.017ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/omicron-zones.json file = common/src/ledger.rs:177
18112024-11-14T16:54:48.017ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/omicron-zones.json file = common/src/ledger.rs:177
18122024-11-14T16:54:48.029ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18132024-11-14T16:54:48.029ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da94b0fc-e114-4d62-8eee-1f3b839145a7
18142024-11-14T16:54:48.056ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18152024-11-14T16:54:48.056ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0e37ddab-daec-4c38-a903-78b351e48433
18162024-11-14T16:54:48.080ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18172024-11-14T16:54:48.080ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a47fbfc2-afec-46c8-bc5a-f6c02b232d2e
18182024-11-14T16:54:48.103ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18192024-11-14T16:54:48.103ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e573afbb-ee4c-4f2d-9d08-b65b7fca29cf
18202024-11-14T16:54:48.125ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18212024-11-14T16:54:48.125ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_63c85555-7e85-4f53-92b1-afc3cd212893
18222024-11-14T16:54:48.146ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8fbbea6c-76df-4af7-a25f-3e2c165ad855 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18232024-11-14T16:54:48.146ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8fbbea6c-76df-4af7-a25f-3e2c165ad855
18242024-11-14T16:54:48.170ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18252024-11-14T16:54:48.170ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad871e3f-9a86-4a01-ac75-964bae58e4aa
18262024-11-14T16:54:48.194ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f3390b76-1a47-437d-b003-6296b24d9932 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18272024-11-14T16:54:48.194ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f3390b76-1a47-437d-b003-6296b24d9932
18282024-11-14T16:54:48.219ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18292024-11-14T16:54:48.219ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c
18302024-11-14T16:54:48.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215948 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38338 req_id = 26f4bc87-fcf1-44c8-acf7-3c4aa64cc91b response_code = 200 uri = /inventory
18312024-11-14T16:54:48.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45415
18322024-11-14T16:54:48.563ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 50069af6-9491-4754-9535-843738a189a5, kind: Service { id: cb30b954-f678-488f-bf13-6a751f361b3f }, name: Name("external-dns-cb30b954-f678-488f-bf13-6a751f361b3f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 18])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e993830-3c47-4e8c-8d42-eec7a6d6efc3, kind: Service { id: 94482e71-9503-4d09-b73f-615fbf343a2e }, name: Name("external-dns-94482e71-9503-4d09-b73f-615fbf343a2e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 30bff459-835e-497d-90ea-b8f3054087c8, kind: Service { id: ce02c1f9-750d-466c-8882-9fa4058550a9 }, name: Name("nexus-ce02c1f9-750d-466c-8882-9fa4058550a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbccdcee-328d-46b4-80f2-6e0f18d211c8, kind: Service { id: 0cc022d1-76d3-4a28-8e75-e8e958faa197 }, name: Name("nexus-0cc022d1-76d3-4a28-8e75-e8e958faa197"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 39])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e712bb0a-d063-491f-bbf4-5dc66991d2fe, kind: Service { id: 2b0034bc-df6c-49bf-ba55-680c74f1cd4c }, name: Name("nexus-2b0034bc-df6c-49bf-ba55-680c74f1cd4c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 214])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18332024-11-14T16:54:48.564ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18342024-11-14T16:54:48.564ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
18352024-11-14T16:54:48.564ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18362024-11-14T16:54:48.564ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18372024-11-14T16:54:48.564ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18382024-11-14T16:54:48.564ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18392024-11-14T16:54:48.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 362 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45415 req_id = 26cd2565-6141-4b86-b32e-77f4ab11f594 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18402024-11-14T16:54:48.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44074
18412024-11-14T16:54:48.583ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 50069af6-9491-4754-9535-843738a189a5, kind: Service { id: cb30b954-f678-488f-bf13-6a751f361b3f }, name: Name("external-dns-cb30b954-f678-488f-bf13-6a751f361b3f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 18])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e993830-3c47-4e8c-8d42-eec7a6d6efc3, kind: Service { id: 94482e71-9503-4d09-b73f-615fbf343a2e }, name: Name("external-dns-94482e71-9503-4d09-b73f-615fbf343a2e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 30bff459-835e-497d-90ea-b8f3054087c8, kind: Service { id: ce02c1f9-750d-466c-8882-9fa4058550a9 }, name: Name("nexus-ce02c1f9-750d-466c-8882-9fa4058550a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbccdcee-328d-46b4-80f2-6e0f18d211c8, kind: Service { id: 0cc022d1-76d3-4a28-8e75-e8e958faa197 }, name: Name("nexus-0cc022d1-76d3-4a28-8e75-e8e958faa197"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 39])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e712bb0a-d063-491f-bbf4-5dc66991d2fe, kind: Service { id: 2b0034bc-df6c-49bf-ba55-680c74f1cd4c }, name: Name("nexus-2b0034bc-df6c-49bf-ba55-680c74f1cd4c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 214])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18422024-11-14T16:54:48.583ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18432024-11-14T16:54:48.583ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
18442024-11-14T16:54:48.583ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18452024-11-14T16:54:48.583ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18462024-11-14T16:54:48.583ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18472024-11-14T16:54:48.583ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18482024-11-14T16:54:48.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 405 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44074 req_id = 7d38580b-0c91-42d2-9d95-09d6c8abfb8a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18492024-11-14T16:54:48.605ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48415
18502024-11-14T16:54:48.606ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 50069af6-9491-4754-9535-843738a189a5, kind: Service { id: cb30b954-f678-488f-bf13-6a751f361b3f }, name: Name("external-dns-cb30b954-f678-488f-bf13-6a751f361b3f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 18])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e993830-3c47-4e8c-8d42-eec7a6d6efc3, kind: Service { id: 94482e71-9503-4d09-b73f-615fbf343a2e }, name: Name("external-dns-94482e71-9503-4d09-b73f-615fbf343a2e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 30bff459-835e-497d-90ea-b8f3054087c8, kind: Service { id: ce02c1f9-750d-466c-8882-9fa4058550a9 }, name: Name("nexus-ce02c1f9-750d-466c-8882-9fa4058550a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbccdcee-328d-46b4-80f2-6e0f18d211c8, kind: Service { id: 0cc022d1-76d3-4a28-8e75-e8e958faa197 }, name: Name("nexus-0cc022d1-76d3-4a28-8e75-e8e958faa197"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 39])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e712bb0a-d063-491f-bbf4-5dc66991d2fe, kind: Service { id: 2b0034bc-df6c-49bf-ba55-680c74f1cd4c }, name: Name("nexus-2b0034bc-df6c-49bf-ba55-680c74f1cd4c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 214])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18512024-11-14T16:54:48.606ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18522024-11-14T16:54:48.606ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
18532024-11-14T16:54:48.606ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18542024-11-14T16:54:48.606ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18552024-11-14T16:54:48.606ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18562024-11-14T16:54:48.606ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18572024-11-14T16:54:48.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48415 req_id = a6dd1e0b-ccd2-404f-ae28-2b5836dc3c5b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18582024-11-14T16:54:53.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32811
18592024-11-14T16:54:53.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32811 req_id = f45386ca-041c-4f42-ac0a-cd84cad5de5e response_code = 200 uri = /vpc-routes
18602024-11-14T16:54:53.913ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
18612024-11-14T16:54:53.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32811 req_id = 579d42b1-72b9-450d-a6ca-007609659699 response_code = 204 uri = /eip-gateways
18622024-11-14T16:54:53.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32811 req_id = 6cc1df86-aef4-46d7-8f20-5506a064964e response_code = 204 uri = /vpc-routes
18632024-11-14T16:55:15.187ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54468
18642024-11-14T16:55:15.187ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54468 req_id = 02ea9ee9-df8d-497c-86c7-b22e4104c891 response_code = 200 uri = /baseboard
18652024-11-14T16:55:17.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45012
18662024-11-14T16:55:17.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45012 req_id = 3a5b48e0-b16b-435f-bcb6-78b04ccadeec response_code = 200 uri = /vpc-routes
18672024-11-14T16:55:17.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47979
18682024-11-14T16:55:17.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47979 req_id = da985cef-67a9-4d7c-8f0c-8f5abd758687 response_code = 200 uri = /vpc-routes
18692024-11-14T16:55:17.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54977
18702024-11-14T16:55:17.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54977 req_id = 98278cd8-145e-4f22-bc48-41ceb60773a4 response_code = 200 uri = /vpc-routes
18712024-11-14T16:55:17.111ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
18722024-11-14T16:55:17.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47979 req_id = 21bf7fca-6b69-4f7b-845f-ba8d9c3295e4 response_code = 204 uri = /eip-gateways
18732024-11-14T16:55:17.119ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
18742024-11-14T16:55:17.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54977 req_id = d804823a-71b7-43c9-bb7e-680c1ed639e8 response_code = 204 uri = /eip-gateways
18752024-11-14T16:55:17.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47979 req_id = 6098fe9e-255a-4c35-8160-e4ff63e870f7 response_code = 204 uri = /vpc-routes
18762024-11-14T16:55:17.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54977 req_id = 838cdfe4-6dd6-4705-961f-06d6e4a12ccd response_code = 204 uri = /vpc-routes
18772024-11-14T16:55:17.144ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
18782024-11-14T16:55:17.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45012 req_id = ecea69d7-34b3-42d0-bd95-48debed7c54a response_code = 204 uri = /eip-gateways
18792024-11-14T16:55:17.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45012 req_id = 73ac0524-66cd-4ecc-a4e4-3f5d95f3bcb3 response_code = 204 uri = /vpc-routes
18802024-11-14T16:55:17.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55251
18812024-11-14T16:55:17.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55251 req_id = a375fc56-c4b1-4278-9fa8-2140a9f39f9a response_code = 200 uri = /v2p
18822024-11-14T16:55:17.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61312
18832024-11-14T16:55:17.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61312 req_id = ed63d7ed-164e-4461-a50e-9394f5146e03 response_code = 200 uri = /v2p
18842024-11-14T16:55:17.406ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44677
18852024-11-14T16:55:17.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44677 req_id = 5911bfea-4579-40a6-ac10-ccec90521ab1 response_code = 200 uri = /v2p
18862024-11-14T16:55:17.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51501
18872024-11-14T16:55:17.497ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18882024-11-14T16:55:17.591ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18892024-11-14T16:55:17.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163415 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51501 req_id = 2a6941d6-52d9-431b-b1af-51d66ebbdc87 response_code = 204 uri = /switch-ports
18902024-11-14T16:55:17.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36390
18912024-11-14T16:55:17.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52631
18922024-11-14T16:55:17.660ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18932024-11-14T16:55:17.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51501 req_id = 4120b92e-f066-4220-8b4e-ff1809450be1 response_code = 200 uri = /network-bootstore-config
18942024-11-14T16:55:17.697ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18952024-11-14T16:55:17.762ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18962024-11-14T16:55:17.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102250 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36390 req_id = cf27583d-800b-4599-8040-bbb349054b55 response_code = 204 uri = /switch-ports
18972024-11-14T16:55:17.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 663 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36390 req_id = 003a049f-f1be-45c8-92eb-49911477f298 response_code = 200 uri = /network-bootstore-config
18982024-11-14T16:55:17.767ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
18992024-11-14T16:55:17.767ZINFOSledAgent (bootstore): Writing ledger to /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19002024-11-14T16:55:17.768ZINFOSledAgent (bootstore): Writing ledger to /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19012024-11-14T16:55:17.769ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
19022024-11-14T16:55:17.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3579 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51501 req_id = 0a438982-25b8-4c3b-9d1f-2cc9503efa82 response_code = 204 uri = /network-bootstore-config
19032024-11-14T16:55:17.800ZINFOSledAgent (bootstore): Attempting to update network config with generation: 3, current_generation: 2 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
19042024-11-14T16:55:17.800ZINFOSledAgent (bootstore): Writing ledger to /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19052024-11-14T16:55:17.800ZINFOSledAgent (bootstore): Writing ledger to /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19062024-11-14T16:55:17.800ZINFOSledAgent (bootstore): Broadcasting network config with generation 3 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
19072024-11-14T16:55:17.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 714 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36390 req_id = 3c1bde6e-fa71-4437-97a0-a279555126a6 response_code = 204 uri = /network-bootstore-config
19082024-11-14T16:55:17.800ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19092024-11-14T16:55:17.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195680 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52631 req_id = 40a527c1-e1f3-40d3-bccc-288bc19b624b response_code = 204 uri = /switch-ports
19102024-11-14T16:55:17.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52631 req_id = b3ce2aa3-1ca8-4daf-a146-1e272150c74a response_code = 200 uri = /network-bootstore-config
19112024-11-14T16:55:17.882ZINFOSledAgent (bootstore): Attempting to update network config with generation: 4, current_generation: 3 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
19122024-11-14T16:55:17.882ZINFOSledAgent (bootstore): Writing ledger to /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19132024-11-14T16:55:17.883ZINFOSledAgent (bootstore): Writing ledger to /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19142024-11-14T16:55:17.883ZINFOSledAgent (bootstore): Broadcasting network config with generation 4 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
19152024-11-14T16:55:17.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 577 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52631 req_id = fa3ba9d4-78eb-4708-81d6-0ca3abfbf619 response_code = 204 uri = /network-bootstore-config
19162024-11-14T16:55:45.235ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34299
19172024-11-14T16:55:45.235ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34299 req_id = 84393719-7562-45bf-a8e8-1db969a4161d response_code = 200 uri = /baseboard
19182024-11-14T16:55:46.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40872
19192024-11-14T16:55:46.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40872 req_id = ba949f9b-4030-4d93-93f1-979df782749e response_code = 200 uri = /vpc-routes
19202024-11-14T16:55:46.953ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
19212024-11-14T16:55:46.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40872 req_id = 43f917fb-1edd-4c89-b1c9-6b69f9bf9e03 response_code = 204 uri = /eip-gateways
19222024-11-14T16:55:46.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49069
19232024-11-14T16:55:46.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49069 req_id = 53600ad2-5a86-461d-ad63-7ad016ec3542 response_code = 200 uri = /vpc-routes
19242024-11-14T16:55:47.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50463
19252024-11-14T16:55:47.010ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19262024-11-14T16:55:47.052ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19272024-11-14T16:55:47.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105196 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50463 req_id = 75a8b0d4-8e66-4458-87e1-0b1d0ba1d1de response_code = 204 uri = /switch-ports
19282024-11-14T16:55:47.115ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
19292024-11-14T16:55:47.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39151
19302024-11-14T16:55:47.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49069 req_id = 7c22f3e2-5879-43db-b53a-05a9d13697d9 response_code = 204 uri = /eip-gateways
19312024-11-14T16:55:47.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41896
19322024-11-14T16:55:47.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50463 req_id = e9003c06-a779-406c-bcbe-2b0444846e67 response_code = 200 uri = /network-bootstore-config
19332024-11-14T16:55:47.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41896 req_id = f65d4e7d-e161-4747-987f-99b92b685e17 response_code = 200 uri = /v2p
19342024-11-14T16:55:47.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 470 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40872 req_id = 4960c4f3-2597-49a9-80d9-15b7a4d0c469 response_code = 204 uri = /vpc-routes
19352024-11-14T16:55:47.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39151 req_id = 27614017-8c25-4d5d-af1e-e97d1687f733 response_code = 200 uri = /vpc-routes
19362024-11-14T16:55:47.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49069 req_id = 3dcb792c-b01b-421e-8b75-84a42f234414 response_code = 204 uri = /vpc-routes
19372024-11-14T16:55:47.161ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43529
19382024-11-14T16:55:47.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43529 req_id = 639d373d-5528-4af1-a376-7737335d6623 response_code = 200 uri = /v2p
19392024-11-14T16:55:47.215ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
19402024-11-14T16:55:47.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39151 req_id = 0abb4ef5-a189-4ee9-a915-de8f6af08025 response_code = 204 uri = /eip-gateways
19412024-11-14T16:55:47.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65348
19422024-11-14T16:55:47.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65348 req_id = ececfab9-b9a4-447a-9097-0175a2a83273 response_code = 200 uri = /v2p
19432024-11-14T16:55:47.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39151 req_id = 01ed3e33-7905-40ab-b498-33ddf3650c9a response_code = 204 uri = /vpc-routes
19442024-11-14T16:55:47.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55920
19452024-11-14T16:55:47.266ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19462024-11-14T16:55:47.301ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19472024-11-14T16:55:47.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89082 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55920 req_id = 7531f8f8-4ece-442a-89ff-96e2822ee68e response_code = 204 uri = /switch-ports
19482024-11-14T16:55:47.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39325
19492024-11-14T16:55:47.355ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19502024-11-14T16:55:47.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55920 req_id = b4af28ce-19de-41b1-aeb0-315472c934b1 response_code = 200 uri = /network-bootstore-config
19512024-11-14T16:55:47.395ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19522024-11-14T16:55:47.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98737 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39325 req_id = 59e59a33-12de-409e-96ee-fa98a7321703 response_code = 204 uri = /switch-ports
19532024-11-14T16:55:47.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39325 req_id = 2e0b7999-91d2-463b-b1cf-c20e92f9e95d response_code = 200 uri = /network-bootstore-config
19542024-11-14T16:56:15.269ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53289
19552024-11-14T16:56:15.269ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53289 req_id = ae443a5d-9cfd-43bd-8369-7953f7f1cf11 response_code = 200 uri = /baseboard
19562024-11-14T16:56:16.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40088
19572024-11-14T16:56:16.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40088 req_id = ab8d1b77-a76b-4047-92f2-0018c12c0772 response_code = 200 uri = /vpc-routes
19582024-11-14T16:56:17.056ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
19592024-11-14T16:56:17.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40088 req_id = 95a3e247-1f48-4071-bed4-e35770e7e920 response_code = 204 uri = /eip-gateways
19602024-11-14T16:56:17.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40088 req_id = 2c67d745-a2cc-4738-81c5-ffe84257633d response_code = 204 uri = /vpc-routes
19612024-11-14T16:56:17.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50789
19622024-11-14T16:56:17.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50789 req_id = 4db8e213-ea3d-4f9a-8b81-bf229bc51837 response_code = 200 uri = /vpc-routes
19632024-11-14T16:56:17.168ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
19642024-11-14T16:56:17.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50789 req_id = 293af3b2-e507-45e9-9278-12ee088c4d49 response_code = 204 uri = /eip-gateways
19652024-11-14T16:56:17.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50789 req_id = 3753dc9d-47ce-4064-9081-6dcff4821a1a response_code = 204 uri = /vpc-routes
19662024-11-14T16:56:17.236ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44673
19672024-11-14T16:56:17.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44673 req_id = ca4db2fe-b341-4046-8edd-d8fcefba8702 response_code = 200 uri = /vpc-routes
19682024-11-14T16:56:17.237ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35336
19692024-11-14T16:56:17.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35336 req_id = 04769705-78df-4460-8af5-a73f129a1440 response_code = 200 uri = /v2p
19702024-11-14T16:56:17.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62851
19712024-11-14T16:56:17.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62851 req_id = 1d6cb46d-90a9-462e-8a01-9782ade9dff1 response_code = 200 uri = /v2p
19722024-11-14T16:56:17.287ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
19732024-11-14T16:56:17.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44673 req_id = 1ef6ad84-99aa-4a5b-837f-1650976a8c85 response_code = 204 uri = /eip-gateways
19742024-11-14T16:56:17.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44673 req_id = ee3442ff-e7d7-4cde-8cde-5914047c26f2 response_code = 204 uri = /vpc-routes
19752024-11-14T16:56:17.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35448
19762024-11-14T16:56:17.316ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19772024-11-14T16:56:17.357ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19782024-11-14T16:56:17.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106434 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35448 req_id = 75e44087-9df6-4e19-8ed5-e122ca568de6 response_code = 204 uri = /switch-ports
19792024-11-14T16:56:17.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38606
19802024-11-14T16:56:17.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64593
19812024-11-14T16:56:17.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37556
19822024-11-14T16:56:17.423ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19832024-11-14T16:56:17.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35448 req_id = 4193bc57-d47c-42b6-bc6b-f11c6ff29bd2 response_code = 200 uri = /network-bootstore-config
19842024-11-14T16:56:17.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4799 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64593 req_id = f7588cd9-abe4-4835-a8fe-b6b06d9c326c response_code = 200 uri = /v2p
19852024-11-14T16:56:17.464ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19862024-11-14T16:56:17.519ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19872024-11-14T16:56:17.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96045 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37556 req_id = 1e9ca501-91fa-4bc6-be6a-31ac0010575f response_code = 204 uri = /switch-ports
19882024-11-14T16:56:17.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 331 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37556 req_id = 3e686902-dda1-4abe-bd7e-350451f6ffd0 response_code = 200 uri = /network-bootstore-config
19892024-11-14T16:56:17.555ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19902024-11-14T16:56:17.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183316 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38606 req_id = 128c096f-553a-44f1-ac04-b3ffa5532c11 response_code = 204 uri = /switch-ports
19912024-11-14T16:56:17.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38606 req_id = fa262dc4-5047-4a8f-ad50-e6240a7d1d93 response_code = 200 uri = /network-bootstore-config
19922024-11-14T16:56:45.307ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58473
19932024-11-14T16:56:45.307ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58473 req_id = 76b51e0f-2924-4121-a3fa-fd21ca683cfb response_code = 200 uri = /baseboard
19942024-11-14T16:56:46.908ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60034
19952024-11-14T16:56:46.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60034 req_id = 7682182f-893e-455f-844f-5808a0ea335f response_code = 200 uri = /vpc-routes
19962024-11-14T16:56:46.967ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
19972024-11-14T16:56:46.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60034 req_id = 862cafa1-71b3-44bd-a4dd-f6f6dafb4bda response_code = 204 uri = /eip-gateways
19982024-11-14T16:56:46.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36867
19992024-11-14T16:56:46.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36867 req_id = 6c8a6579-a7f9-437d-a060-3d35064bcaed response_code = 200 uri = /vpc-routes
20002024-11-14T16:56:46.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60034 req_id = 5cea53ec-2bc0-4891-8e4b-38700c5ba842 response_code = 204 uri = /vpc-routes
20012024-11-14T16:56:47.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34351
20022024-11-14T16:56:47.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34351 req_id = 7239d344-5d2e-4448-ac2e-8e495e23292b response_code = 200 uri = /v2p
20032024-11-14T16:56:47.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33556
20042024-11-14T16:56:47.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33556 req_id = c52b15e9-8701-4259-9f6f-d0a66d4ecc95 response_code = 200 uri = /vpc-routes
20052024-11-14T16:56:47.027ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
20062024-11-14T16:56:47.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36867 req_id = c2a0021a-f234-4833-8bb6-a279175bb960 response_code = 204 uri = /eip-gateways
20072024-11-14T16:56:47.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36867 req_id = b006719d-f85f-4112-9605-a56b48348a77 response_code = 204 uri = /vpc-routes
20082024-11-14T16:56:47.038ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
20092024-11-14T16:56:47.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33556 req_id = dae8161d-d6b8-4630-95d0-c1976c2d738b response_code = 204 uri = /eip-gateways
20102024-11-14T16:56:47.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47123
20112024-11-14T16:56:47.049ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20122024-11-14T16:56:47.089ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20132024-11-14T16:56:47.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97145 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47123 req_id = bb68c7f9-fe78-48d5-a01f-8067c10ba838 response_code = 204 uri = /switch-ports
20142024-11-14T16:56:47.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56278
20152024-11-14T16:56:47.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34335
20162024-11-14T16:56:47.147ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20172024-11-14T16:56:47.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3574 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56278 req_id = 3890b8e7-95f2-4f6f-94e0-f24360ce9eee response_code = 200 uri = /v2p
20182024-11-14T16:56:47.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3645 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47123 req_id = a3ce31ae-eea2-4b43-877e-eff27180b5bb response_code = 200 uri = /network-bootstore-config
20192024-11-14T16:56:47.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60976
20202024-11-14T16:56:47.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60976 req_id = 4299abec-23ed-4f84-9d73-6235aa56eb0f response_code = 200 uri = /v2p
20212024-11-14T16:56:47.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33556 req_id = 62b363a8-4216-4013-a70c-1b8b2d1dedf6 response_code = 204 uri = /vpc-routes
20222024-11-14T16:56:47.185ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20232024-11-14T16:56:47.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94863 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34335 req_id = fab570d3-dcb2-4a5e-bc3b-0ec1124e9978 response_code = 204 uri = /switch-ports
20242024-11-14T16:56:47.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34335 req_id = cd54d8a3-b9ad-4bb1-8e56-8f5b7176a3ee response_code = 200 uri = /network-bootstore-config
20252024-11-14T16:56:47.281ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53287
20262024-11-14T16:56:47.281ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20272024-11-14T16:56:47.317ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20282024-11-14T16:56:47.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93046 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53287 req_id = c20a8ae0-d25a-4af4-94a7-8152bb11363e response_code = 204 uri = /switch-ports
20292024-11-14T16:56:47.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53287 req_id = 68bb127b-cd85-400a-b13d-64c77b976e59 response_code = 200 uri = /network-bootstore-config
20302024-11-14T16:57:09.167ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20312024-11-14T16:57:15.340ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54813
20322024-11-14T16:57:15.340ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54813 req_id = 7c2741ed-e06c-4a3d-885d-cb31ae99199c response_code = 200 uri = /baseboard
20332024-11-14T16:57:17.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63809
20342024-11-14T16:57:17.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63809 req_id = bf4fede5-1925-4155-b677-3c75199f498e response_code = 200 uri = /vpc-routes
20352024-11-14T16:57:17.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54599
20362024-11-14T16:57:17.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54599 req_id = 265fb3fe-35cd-469b-855b-97acb4d3d6e0 response_code = 200 uri = /vpc-routes
20372024-11-14T16:57:17.328ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
20382024-11-14T16:57:17.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63809 req_id = 9f890c95-a25e-4a32-84d1-2ee3583ebb81 response_code = 204 uri = /eip-gateways
20392024-11-14T16:57:17.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63809 req_id = aca8daec-7623-40e0-96e0-50f3664c4d7c response_code = 204 uri = /vpc-routes
20402024-11-14T16:57:17.350ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
20412024-11-14T16:57:17.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54599 req_id = 368a3d36-ca61-4302-b192-f55076faba6a response_code = 204 uri = /eip-gateways
20422024-11-14T16:57:17.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54599 req_id = c8eaf1a6-e182-4452-a176-bc28b6bc419c response_code = 204 uri = /vpc-routes
20432024-11-14T16:57:17.397ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49659
20442024-11-14T16:57:17.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49659 req_id = a169748d-359a-43ce-8279-8bf331f0f415 response_code = 200 uri = /vpc-routes
20452024-11-14T16:57:17.429ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60273
20462024-11-14T16:57:17.429ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20472024-11-14T16:57:17.474ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20482024-11-14T16:57:17.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107125 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60273 req_id = 1c7bc039-46c9-44de-aeb4-f5837a333bbe response_code = 204 uri = /switch-ports
20492024-11-14T16:57:17.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51712
20502024-11-14T16:57:17.537ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
20512024-11-14T16:57:17.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47532
20522024-11-14T16:57:17.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49659 req_id = 98b6b11f-a8ac-4569-be6d-908ca226a6bf response_code = 204 uri = /eip-gateways
20532024-11-14T16:57:17.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53318
20542024-11-14T16:57:17.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60258
20552024-11-14T16:57:17.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 331 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60273 req_id = bc2f9b5c-665b-4565-b2b6-189d046ad797 response_code = 200 uri = /network-bootstore-config
20562024-11-14T16:57:17.537ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20572024-11-14T16:57:17.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3890 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60258 req_id = f6138ed6-0c6e-4cb3-95be-e3ae0c8641e8 response_code = 200 uri = /v2p
20582024-11-14T16:57:17.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53318 req_id = 6c628809-9405-4553-9b10-7394955cedd5 response_code = 200 uri = /v2p
20592024-11-14T16:57:17.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65159
20602024-11-14T16:57:17.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49659 req_id = 8643f9a6-f9ef-493c-8f24-19db935639e3 response_code = 204 uri = /vpc-routes
20612024-11-14T16:57:17.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65159 req_id = b6a259a7-2280-4533-ad30-2ea2df858257 response_code = 200 uri = /v2p
20622024-11-14T16:57:17.577ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20632024-11-14T16:57:17.635ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20642024-11-14T16:57:17.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98313 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51712 req_id = ae64f17d-b543-4631-83da-82567a318ce9 response_code = 204 uri = /switch-ports
20652024-11-14T16:57:17.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 667 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51712 req_id = 975596a1-2e79-4886-a5db-d0d80b1f34d9 response_code = 200 uri = /network-bootstore-config
20662024-11-14T16:57:17.671ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20672024-11-14T16:57:17.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186959 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47532 req_id = 3dc30a9b-9a81-4f70-b3b3-b3bd7a00a40a response_code = 204 uri = /switch-ports
20682024-11-14T16:57:17.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47532 req_id = 044f9c19-ac5d-4e9d-9f46-5d19c034e57e response_code = 200 uri = /network-bootstore-config
20692024-11-14T16:57:45.372ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40987
20702024-11-14T16:57:45.372ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40987 req_id = 7e162f40-644c-4834-96a5-059817b25e37 response_code = 200 uri = /baseboard
20712024-11-14T16:57:46.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60487
20722024-11-14T16:57:46.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60487 req_id = 1545fa55-6f18-468b-9426-4cd426b968d5 response_code = 200 uri = /vpc-routes
20732024-11-14T16:57:46.962ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
20742024-11-14T16:57:46.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60487 req_id = dfa807be-9853-4141-953d-6d3fbafa32e2 response_code = 204 uri = /eip-gateways
20752024-11-14T16:57:46.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63565
20762024-11-14T16:57:46.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63565 req_id = c88a062a-de46-4186-8c5a-5aba5e470d9a response_code = 200 uri = /vpc-routes
20772024-11-14T16:57:46.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 860 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60487 req_id = 0d298c0e-abc7-41d6-804d-46176cb5f3c4 response_code = 204 uri = /vpc-routes
20782024-11-14T16:57:47.035ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
20792024-11-14T16:57:47.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63565 req_id = bee356d4-2d7d-4cc8-9789-e55506352737 response_code = 204 uri = /eip-gateways
20802024-11-14T16:57:47.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63565 req_id = 4ccf8ee5-de7d-4c84-8c01-7563b771ae73 response_code = 204 uri = /vpc-routes
20812024-11-14T16:57:47.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54928
20822024-11-14T16:57:47.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54928 req_id = 1fa1dcdf-4ec1-43e3-afeb-a4fd7e910b0f response_code = 200 uri = /v2p
20832024-11-14T16:57:47.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40476
20842024-11-14T16:57:47.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40476 req_id = 58f7d938-6029-4757-a18c-7a67903b1739 response_code = 200 uri = /vpc-routes
20852024-11-14T16:57:47.084ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58190
20862024-11-14T16:57:47.084ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20872024-11-14T16:57:47.122ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20882024-11-14T16:57:47.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94950 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58190 req_id = 427cb827-0da0-484d-b442-debda895e1c9 response_code = 204 uri = /switch-ports
20892024-11-14T16:57:47.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61403
20902024-11-14T16:57:47.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61308
20912024-11-14T16:57:47.179ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
20922024-11-14T16:57:47.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40476 req_id = 242f7595-15ab-4de6-94ae-909ca55d6f85 response_code = 204 uri = /eip-gateways
20932024-11-14T16:57:47.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58190 req_id = 4b858472-80b9-45c7-8bcb-328fa89031e6 response_code = 200 uri = /network-bootstore-config
20942024-11-14T16:57:47.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 881 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61308 req_id = 60fb297d-9d3d-4128-880c-5b5788c57c54 response_code = 200 uri = /v2p
20952024-11-14T16:57:47.180ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20962024-11-14T16:57:47.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 499 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40476 req_id = d8efbac7-9688-4d1d-b57c-afba6d673563 response_code = 204 uri = /vpc-routes
20972024-11-14T16:57:47.219ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20982024-11-14T16:57:47.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38784
20992024-11-14T16:57:47.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38784 req_id = a855d1d6-0edb-4a96-b13f-ce133933f07e response_code = 200 uri = /v2p
21002024-11-14T16:57:47.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102686 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61403 req_id = 93db3475-d260-4aaf-92fb-a26f41f98597 response_code = 204 uri = /switch-ports
21012024-11-14T16:57:47.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61403 req_id = 5d3e0b96-f34e-4316-879b-420c476933cf response_code = 200 uri = /network-bootstore-config
21022024-11-14T16:57:47.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54239
21032024-11-14T16:57:47.306ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21042024-11-14T16:57:47.342ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21052024-11-14T16:57:47.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98620 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54239 req_id = c1ddef11-87f6-4761-b7c1-4965c0280cc8 response_code = 204 uri = /switch-ports
21062024-11-14T16:57:47.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54239 req_id = 27de2036-96ef-40ff-b25c-b6c521256f95 response_code = 200 uri = /network-bootstore-config
21072024-11-14T16:58:15.406ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43882
21082024-11-14T16:58:15.406ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43882 req_id = 508339fa-7b83-40ac-89dd-8f05908d3b4b response_code = 200 uri = /baseboard
21092024-11-14T16:58:17.127ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35156
21102024-11-14T16:58:17.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 549 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35156 req_id = ef82ca1a-2d6d-4da7-b381-fa2fa156d914 response_code = 200 uri = /vpc-routes
21112024-11-14T16:58:17.172ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
21122024-11-14T16:58:17.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35156 req_id = 8eb39d8f-fa52-4ea8-b5ff-32e20fa53bf8 response_code = 204 uri = /eip-gateways
21132024-11-14T16:58:17.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35156 req_id = 9ab49c14-dbcf-4307-afc7-6ac1d9e980e1 response_code = 204 uri = /vpc-routes
21142024-11-14T16:58:17.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59075
21152024-11-14T16:58:17.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59075 req_id = 899972ac-cbc5-40a5-ae8e-fc9228dc9780 response_code = 200 uri = /vpc-routes
21162024-11-14T16:58:17.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40057
21172024-11-14T16:58:17.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40057 req_id = 31d3b557-0488-4843-8444-0168b3834cb3 response_code = 200 uri = /v2p
21182024-11-14T16:58:17.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50050
21192024-11-14T16:58:17.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50050 req_id = 9e19586c-44d9-4876-87f7-ddb4499b5b93 response_code = 200 uri = /vpc-routes
21202024-11-14T16:58:17.212ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
21212024-11-14T16:58:17.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59075 req_id = cc9b47d5-840f-4cc3-b514-6f31a346740f response_code = 204 uri = /eip-gateways
21222024-11-14T16:58:17.249ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
21232024-11-14T16:58:17.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50050 req_id = af7cb74e-967e-4a12-8057-20806a4d7b51 response_code = 204 uri = /eip-gateways
21242024-11-14T16:58:17.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50050 req_id = 8bbc50cb-11aa-4599-ac85-6debf0ffffa5 response_code = 204 uri = /vpc-routes
21252024-11-14T16:58:17.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33649
21262024-11-14T16:58:17.269ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21272024-11-14T16:58:17.306ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21282024-11-14T16:58:17.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93407 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33649 req_id = f23821c7-9f65-4dbd-8e75-2aad8e4dbc5d response_code = 204 uri = /switch-ports
21292024-11-14T16:58:17.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43977
21302024-11-14T16:58:17.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43977 req_id = ac1ec9f8-b1d2-4b04-a6ab-6f33f395ccdb response_code = 200 uri = /v2p
21312024-11-14T16:58:17.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33649 req_id = 83d0dc64-79c9-4176-9c06-bf2cb14ba346 response_code = 200 uri = /network-bootstore-config
21322024-11-14T16:58:17.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60755
21332024-11-14T16:58:17.382ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21342024-11-14T16:58:17.420ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21352024-11-14T16:58:17.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104204 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60755 req_id = 00f5623e-67e4-4958-9b42-f341519fd594 response_code = 204 uri = /switch-ports
21362024-11-14T16:58:17.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46836
21372024-11-14T16:58:17.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50111
21382024-11-14T16:58:17.487ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21392024-11-14T16:58:17.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 330 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60755 req_id = bf8f1e38-fb89-4c65-974b-2e3430d73285 response_code = 200 uri = /network-bootstore-config
21402024-11-14T16:58:17.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4553 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46836 req_id = f5a7d583-a3a1-4555-bb8b-c0a121e14c2f response_code = 200 uri = /v2p
21412024-11-14T16:58:17.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4733 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59075 req_id = 29ec99d7-ae67-4da6-88e3-6e43a78186dd response_code = 204 uri = /vpc-routes
21422024-11-14T16:58:17.525ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21432024-11-14T16:58:17.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92733 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50111 req_id = 81979d9f-db97-44c5-9b71-c185512441eb response_code = 204 uri = /switch-ports
21442024-11-14T16:58:17.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50111 req_id = f7abba10-2d2f-4966-bb8c-4cadec8f7f8d response_code = 200 uri = /network-bootstore-config
21452024-11-14T16:58:45.438ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62622
21462024-11-14T16:58:45.438ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62622 req_id = ef511dac-303e-4d6c-8ef0-3c6bff93b5e6 response_code = 200 uri = /baseboard
21472024-11-14T16:58:46.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47928
21482024-11-14T16:58:46.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47928 req_id = e4811923-d3d8-4f5d-a065-4f8ee392b837 response_code = 200 uri = /vpc-routes
21492024-11-14T16:58:46.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55930
21502024-11-14T16:58:46.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55930 req_id = a4eb8dda-66be-49b7-a8e5-83b7be286f01 response_code = 200 uri = /vpc-routes
21512024-11-14T16:58:46.973ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
21522024-11-14T16:58:46.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47928 req_id = e525844f-bcf1-467f-b74e-c91c0f323131 response_code = 204 uri = /eip-gateways
21532024-11-14T16:58:47.013ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35320
21542024-11-14T16:58:47.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35320 req_id = f76ff058-79cf-4dfd-8a8d-00e93dd0c73d response_code = 200 uri = /v2p
21552024-11-14T16:58:47.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47928 req_id = 24b44ce2-47d3-4a3f-afcd-b7d7f5da7999 response_code = 204 uri = /vpc-routes
21562024-11-14T16:58:47.029ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
21572024-11-14T16:58:47.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55930 req_id = 553f8016-05a7-45f3-9f2b-cfcb004df92e response_code = 204 uri = /eip-gateways
21582024-11-14T16:58:47.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55930 req_id = 0fc1e45c-2305-44c2-8d5c-db319632f0e8 response_code = 204 uri = /vpc-routes
21592024-11-14T16:58:47.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54497
21602024-11-14T16:58:47.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54497 req_id = af763e1b-4d6d-4dbe-afd5-610bc1365507 response_code = 200 uri = /vpc-routes
21612024-11-14T16:58:47.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46332
21622024-11-14T16:58:47.076ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21632024-11-14T16:58:47.119ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21642024-11-14T16:58:47.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103708 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46332 req_id = 7cbfeebf-4567-4746-92d7-db793cd1e69a response_code = 204 uri = /switch-ports
21652024-11-14T16:58:47.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55677
21662024-11-14T16:58:47.180ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
21672024-11-14T16:58:47.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54497 req_id = f2ae0c80-6317-414a-b56d-2a6cfb998f9c response_code = 204 uri = /eip-gateways
21682024-11-14T16:58:47.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47623
21692024-11-14T16:58:47.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49394
21702024-11-14T16:58:47.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65045
21712024-11-14T16:58:47.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55677 req_id = c7d4a52d-95e1-4b76-afaf-9d0e854c4579 response_code = 200 uri = /v2p
21722024-11-14T16:58:47.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 346 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46332 req_id = 704df4e3-7b80-462e-9cf7-4ed31ba47a23 response_code = 200 uri = /network-bootstore-config
21732024-11-14T16:58:47.180ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21742024-11-14T16:58:47.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65045 req_id = da4ed56f-4edf-46d6-b97d-b89f021b0fae response_code = 200 uri = /v2p
21752024-11-14T16:58:47.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54497 req_id = 8b192fb3-1abc-4c65-b0a8-3529e679cdd8 response_code = 204 uri = /vpc-routes
21762024-11-14T16:58:47.218ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21772024-11-14T16:58:47.273ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21782024-11-14T16:58:47.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93339 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49394 req_id = 44ec46e6-9a5e-4cd2-b533-b0bd9ba41d8b response_code = 204 uri = /switch-ports
21792024-11-14T16:58:47.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 707 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49394 req_id = 5f459fd8-2116-47f3-8eb9-f6326a8a5b4b response_code = 200 uri = /network-bootstore-config
21802024-11-14T16:58:47.308ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21812024-11-14T16:58:47.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182911 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47623 req_id = d722a2f8-6bf4-41a6-9627-a3cb0935c534 response_code = 204 uri = /switch-ports
21822024-11-14T16:58:47.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47623 req_id = f1220dde-a0eb-4d44-a99f-05987e183d64 response_code = 200 uri = /network-bootstore-config
21832024-11-14T16:59:15.470ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64422
21842024-11-14T16:59:15.470ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64422 req_id = 52b60b7c-63d5-4940-8330-9e56fab568db response_code = 200 uri = /baseboard
21852024-11-14T16:59:17.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60733
21862024-11-14T16:59:17.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60733 req_id = e25aacd3-1763-44b8-914d-1d9c7f927189 response_code = 200 uri = /vpc-routes
21872024-11-14T16:59:17.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56228
21882024-11-14T16:59:17.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56228 req_id = b0e31d6e-e852-4499-8922-9c4420b2a1b1 response_code = 200 uri = /vpc-routes
21892024-11-14T16:59:17.108ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
21902024-11-14T16:59:17.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60733 req_id = 9ffc5ebe-e704-4dc3-aab1-efed7c7b26d9 response_code = 204 uri = /eip-gateways
21912024-11-14T16:59:17.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43302
21922024-11-14T16:59:17.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43302 req_id = 750bf81d-c359-4df7-b3ff-a4cea74e0b84 response_code = 200 uri = /v2p
21932024-11-14T16:59:17.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60733 req_id = 2f8f41cf-ea39-4255-a040-f263d968c913 response_code = 204 uri = /vpc-routes
21942024-11-14T16:59:17.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38655
21952024-11-14T16:59:17.287ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21962024-11-14T16:59:17.331ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21972024-11-14T16:59:17.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122347 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38655 req_id = 68974ef6-27f0-4da7-8c93-c18097668bcc response_code = 204 uri = /switch-ports
21982024-11-14T16:59:17.410ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41477
21992024-11-14T16:59:17.410ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57294
22002024-11-14T16:59:17.410ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
22012024-11-14T16:59:17.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 326 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38655 req_id = b6f62cc7-1de1-483f-b990-228c7ca189b0 response_code = 200 uri = /network-bootstore-config
22022024-11-14T16:59:17.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 609 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56228 req_id = de673e74-d83f-4b62-bb2c-8966095cc62f response_code = 204 uri = /eip-gateways
22032024-11-14T16:59:17.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57294 req_id = 5ddbcfce-cca7-45c1-b463-26ecf5f464db response_code = 200 uri = /vpc-routes
22042024-11-14T16:59:17.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41477 req_id = 22502a8f-b71c-45df-b0cd-1806faa1e8e4 response_code = 200 uri = /v2p
22052024-11-14T16:59:17.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 347 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56228 req_id = 7a32b084-5a5a-4c01-a4b6-9f169a14b6c9 response_code = 204 uri = /vpc-routes
22062024-11-14T16:59:17.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45801
22072024-11-14T16:59:17.437ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22082024-11-14T16:59:17.476ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22092024-11-14T16:59:17.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102396 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45801 req_id = 4eb08dea-70f1-4d3d-941a-749070aded3c response_code = 204 uri = /switch-ports
22102024-11-14T16:59:17.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52785
22112024-11-14T16:59:17.540ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
22122024-11-14T16:59:17.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57294 req_id = d8d81249-2cf2-47f7-9bad-6a3d3fc29090 response_code = 204 uri = /eip-gateways
22132024-11-14T16:59:17.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57735
22142024-11-14T16:59:17.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44234
22152024-11-14T16:59:17.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46742
22162024-11-14T16:59:17.540ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 50069af6-9491-4754-9535-843738a189a5, kind: Service { id: cb30b954-f678-488f-bf13-6a751f361b3f }, name: Name("external-dns-cb30b954-f678-488f-bf13-6a751f361b3f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 18])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e993830-3c47-4e8c-8d42-eec7a6d6efc3, kind: Service { id: 94482e71-9503-4d09-b73f-615fbf343a2e }, name: Name("external-dns-94482e71-9503-4d09-b73f-615fbf343a2e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 30bff459-835e-497d-90ea-b8f3054087c8, kind: Service { id: ce02c1f9-750d-466c-8882-9fa4058550a9 }, name: Name("nexus-ce02c1f9-750d-466c-8882-9fa4058550a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbccdcee-328d-46b4-80f2-6e0f18d211c8, kind: Service { id: 0cc022d1-76d3-4a28-8e75-e8e958faa197 }, name: Name("nexus-0cc022d1-76d3-4a28-8e75-e8e958faa197"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 39])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e712bb0a-d063-491f-bbf4-5dc66991d2fe, kind: Service { id: 2b0034bc-df6c-49bf-ba55-680c74f1cd4c }, name: Name("nexus-2b0034bc-df6c-49bf-ba55-680c74f1cd4c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 214])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22172024-11-14T16:59:17.540ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22182024-11-14T16:59:17.540ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22192024-11-14T16:59:17.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45801 req_id = 737e5343-5b10-4d58-bf0b-fa0a23de2092 response_code = 200 uri = /network-bootstore-config
22202024-11-14T16:59:17.541ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
22212024-11-14T16:59:17.544ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22222024-11-14T16:59:17.544ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22232024-11-14T16:59:17.544ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22242024-11-14T16:59:17.544ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22252024-11-14T16:59:17.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4510 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52785 req_id = a46e9df9-2872-4b27-a320-c91434a63f92 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22262024-11-14T16:59:17.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4475 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46742 req_id = ebbc9058-5a87-4164-af0b-8f9ce4632553 response_code = 200 uri = /v2p
22272024-11-14T16:59:17.545ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 50069af6-9491-4754-9535-843738a189a5, kind: Service { id: cb30b954-f678-488f-bf13-6a751f361b3f }, name: Name("external-dns-cb30b954-f678-488f-bf13-6a751f361b3f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 18])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e993830-3c47-4e8c-8d42-eec7a6d6efc3, kind: Service { id: 94482e71-9503-4d09-b73f-615fbf343a2e }, name: Name("external-dns-94482e71-9503-4d09-b73f-615fbf343a2e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 30bff459-835e-497d-90ea-b8f3054087c8, kind: Service { id: ce02c1f9-750d-466c-8882-9fa4058550a9 }, name: Name("nexus-ce02c1f9-750d-466c-8882-9fa4058550a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbccdcee-328d-46b4-80f2-6e0f18d211c8, kind: Service { id: 0cc022d1-76d3-4a28-8e75-e8e958faa197 }, name: Name("nexus-0cc022d1-76d3-4a28-8e75-e8e958faa197"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 39])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e712bb0a-d063-491f-bbf4-5dc66991d2fe, kind: Service { id: 2b0034bc-df6c-49bf-ba55-680c74f1cd4c }, name: Name("nexus-2b0034bc-df6c-49bf-ba55-680c74f1cd4c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 214])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22282024-11-14T16:59:17.545ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22292024-11-14T16:59:17.545ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
22302024-11-14T16:59:17.545ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22312024-11-14T16:59:17.545ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22322024-11-14T16:59:17.545ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22332024-11-14T16:59:17.545ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22342024-11-14T16:59:17.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4792 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44234 req_id = 6d2a8baf-0f34-4419-a112-2b1dc821d93c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22352024-11-14T16:59:17.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57294 req_id = 3332899a-00b8-42ff-9975-f8feef531d16 response_code = 204 uri = /vpc-routes
22362024-11-14T16:59:17.580ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22372024-11-14T16:59:17.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49518
22382024-11-14T16:59:17.632ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 50069af6-9491-4754-9535-843738a189a5, kind: Service { id: cb30b954-f678-488f-bf13-6a751f361b3f }, name: Name("external-dns-cb30b954-f678-488f-bf13-6a751f361b3f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 18])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e993830-3c47-4e8c-8d42-eec7a6d6efc3, kind: Service { id: 94482e71-9503-4d09-b73f-615fbf343a2e }, name: Name("external-dns-94482e71-9503-4d09-b73f-615fbf343a2e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 30bff459-835e-497d-90ea-b8f3054087c8, kind: Service { id: ce02c1f9-750d-466c-8882-9fa4058550a9 }, name: Name("nexus-ce02c1f9-750d-466c-8882-9fa4058550a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbccdcee-328d-46b4-80f2-6e0f18d211c8, kind: Service { id: 0cc022d1-76d3-4a28-8e75-e8e958faa197 }, name: Name("nexus-0cc022d1-76d3-4a28-8e75-e8e958faa197"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 39])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e712bb0a-d063-491f-bbf4-5dc66991d2fe, kind: Service { id: 2b0034bc-df6c-49bf-ba55-680c74f1cd4c }, name: Name("nexus-2b0034bc-df6c-49bf-ba55-680c74f1cd4c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 214])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22392024-11-14T16:59:17.632ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22402024-11-14T16:59:17.633ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
22412024-11-14T16:59:17.633ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22422024-11-14T16:59:17.633ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22432024-11-14T16:59:17.633ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22442024-11-14T16:59:17.633ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22452024-11-14T16:59:17.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 548 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49518 req_id = f49fb974-9e43-4b53-9dc7-09ded512402a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22462024-11-14T16:59:17.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99340 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57735 req_id = b28e0b59-807f-4f5b-b383-1f58ba44a472 response_code = 204 uri = /switch-ports
22472024-11-14T16:59:17.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57735 req_id = 9d53100c-9b57-479d-bf84-909c6acd126a response_code = 200 uri = /network-bootstore-config
22482024-11-14T16:59:45.502ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63542
22492024-11-14T16:59:45.502ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63542 req_id = 56eda41d-eb79-4565-88fc-66f6d0ac118a response_code = 200 uri = /baseboard
22502024-11-14T16:59:46.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39925
22512024-11-14T16:59:46.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39925 req_id = 0dfe089d-d2e7-40e8-8d90-c62174217ad2 response_code = 200 uri = /vpc-routes
22522024-11-14T16:59:46.909ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
22532024-11-14T16:59:46.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39925 req_id = 679f8055-a57a-4f15-ba4e-f9372f43bc29 response_code = 204 uri = /eip-gateways
22542024-11-14T16:59:46.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39925 req_id = 6d62c2a7-a999-43e8-87bf-f93331f4df19 response_code = 204 uri = /vpc-routes
22552024-11-14T16:59:46.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43552
22562024-11-14T16:59:46.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43552 req_id = 23e09b73-69fe-4b09-9b1c-48291a2e1378 response_code = 200 uri = /vpc-routes
22572024-11-14T16:59:47.020ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
22582024-11-14T16:59:47.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43552 req_id = 7ce0c5c1-329f-4afe-8a34-ab40fede52bb response_code = 204 uri = /eip-gateways
22592024-11-14T16:59:47.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41042
22602024-11-14T16:59:47.025ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22612024-11-14T16:59:47.067ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22622024-11-14T16:59:47.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99759 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41042 req_id = 1736f508-f11f-4eb7-a89b-79582daf9c1d response_code = 204 uri = /switch-ports
22632024-11-14T16:59:47.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48514
22642024-11-14T16:59:47.125ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49454
22652024-11-14T16:59:47.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 339 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41042 req_id = 3dcf6ed9-3949-4df0-8b9c-6a1f29a21871 response_code = 200 uri = /network-bootstore-config
22662024-11-14T16:59:47.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 403 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43552 req_id = 19b84c64-aaa9-4c77-98f7-2ced51c0bb49 response_code = 204 uri = /vpc-routes
22672024-11-14T16:59:47.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48514 req_id = 8f1ec5d6-f598-4854-9033-5f487432c08b response_code = 200 uri = /vpc-routes
22682024-11-14T16:59:47.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49454 req_id = 9760aba3-3c4b-4c99-9eeb-23ca6514a768 response_code = 200 uri = /v2p
22692024-11-14T16:59:47.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36501
22702024-11-14T16:59:47.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36501 req_id = 84c85cd5-3ad6-435b-bc39-22463d10f494 response_code = 200 uri = /v2p
22712024-11-14T16:59:47.162ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46202
22722024-11-14T16:59:47.162ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22732024-11-14T16:59:47.202ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22742024-11-14T16:59:47.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103417 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46202 req_id = b548fc3b-108e-4ade-9cc1-645018342e08 response_code = 204 uri = /switch-ports
22752024-11-14T16:59:47.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43163
22762024-11-14T16:59:47.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42942
22772024-11-14T16:59:47.266ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
22782024-11-14T16:59:47.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48514 req_id = fa49f722-d176-435e-86ec-c2d11aec2dc4 response_code = 204 uri = /eip-gateways
22792024-11-14T16:59:47.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43163 req_id = 398ad2b1-d07e-4dd1-ac1b-94a380ece6bc response_code = 200 uri = /v2p
22802024-11-14T16:59:47.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 319 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46202 req_id = a4225d91-158a-42e1-87cb-b06caf866540 response_code = 200 uri = /network-bootstore-config
22812024-11-14T16:59:47.266ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22822024-11-14T16:59:47.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48514 req_id = 292455b4-5c62-4ab7-848b-b8d3f92dda14 response_code = 204 uri = /vpc-routes
22832024-11-14T16:59:47.306ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22842024-11-14T16:59:47.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98009 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42942 req_id = 9efee7ea-6665-4c90-be47-18cd535cd456 response_code = 204 uri = /switch-ports
22852024-11-14T16:59:47.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42942 req_id = 2bec8609-3820-4d32-8ed6-e26f559f0125 response_code = 200 uri = /network-bootstore-config
22862024-11-14T17:00:15.534ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60264
22872024-11-14T17:00:15.534ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60264 req_id = 39b38534-ac24-48b2-9311-12fb29443687 response_code = 200 uri = /baseboard
22882024-11-14T17:00:17.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60961
22892024-11-14T17:00:17.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60961 req_id = 6bdbedc1-fefb-40c9-a00f-9cfa16903c26 response_code = 200 uri = /vpc-routes
22902024-11-14T17:00:17.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42122
22912024-11-14T17:00:17.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42122 req_id = 4eb1549b-82e2-4e9d-b204-703e708495bb response_code = 200 uri = /vpc-routes
22922024-11-14T17:00:17.194ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
22932024-11-14T17:00:17.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60961 req_id = a17b686a-4f9c-4b2b-9953-034904fd1878 response_code = 204 uri = /eip-gateways
22942024-11-14T17:00:17.197ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
22952024-11-14T17:00:17.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42122 req_id = d5844301-6f10-405c-a7b1-993958085475 response_code = 204 uri = /eip-gateways
22962024-11-14T17:00:17.209ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38989
22972024-11-14T17:00:17.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38989 req_id = 620faf14-795f-45ff-8e57-4afac3db3e40 response_code = 200 uri = /vpc-routes
22982024-11-14T17:00:17.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60961 req_id = 99c5df08-2773-4fb3-b66e-360f28a9c7cf response_code = 204 uri = /vpc-routes
22992024-11-14T17:00:17.232ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
23002024-11-14T17:00:17.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38989 req_id = c8c6c1ba-8600-4294-8690-072433fbcf6d response_code = 204 uri = /eip-gateways
23012024-11-14T17:00:17.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38989 req_id = cbc6b58a-e184-4f49-b5b8-5fb018451e0a response_code = 204 uri = /vpc-routes
23022024-11-14T17:00:17.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35665
23032024-11-14T17:00:17.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35665 req_id = d17ee1e5-39ae-4744-a9e9-695f812864a7 response_code = 200 uri = /v2p
23042024-11-14T17:00:17.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42122 req_id = 97a3efef-9007-4a07-ad8b-e9fdac48a9a1 response_code = 204 uri = /vpc-routes
23052024-11-14T17:00:17.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46101
23062024-11-14T17:00:17.356ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23072024-11-14T17:00:17.400ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23082024-11-14T17:00:17.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119435 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46101 req_id = 7414aa3e-de42-4fb8-a39c-697fb602bffc response_code = 204 uri = /switch-ports
23092024-11-14T17:00:17.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49609
23102024-11-14T17:00:17.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58400
23112024-11-14T17:00:17.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51852
23122024-11-14T17:00:17.476ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23132024-11-14T17:00:17.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5676 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58400 req_id = f03f867d-2c1e-4e08-8fad-1e4cd7f59d24 response_code = 200 uri = /v2p
23142024-11-14T17:00:17.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5842 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46101 req_id = 5cec3d41-21b4-4e24-8ca0-22854084d506 response_code = 200 uri = /network-bootstore-config
23152024-11-14T17:00:17.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5866 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49609 req_id = ac2cb77b-dc68-4b2e-93b7-0000c5e8d2d4 response_code = 200 uri = /v2p
23162024-11-14T17:00:17.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64914
23172024-11-14T17:00:17.527ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23182024-11-14T17:00:17.623ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23192024-11-14T17:00:17.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147643 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51852 req_id = 6871d008-9dab-4fa3-ae6d-71517550ed74 response_code = 204 uri = /switch-ports
23202024-11-14T17:00:17.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 762 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51852 req_id = a4f49978-e20d-43fe-b824-6221c80a9dd7 response_code = 200 uri = /network-bootstore-config
23212024-11-14T17:00:17.667ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23222024-11-14T17:00:17.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248289 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64914 req_id = eb8c7118-4940-4864-a119-34a57bcd74fb response_code = 204 uri = /switch-ports
23232024-11-14T17:00:17.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64914 req_id = e44a4a6e-bbea-4471-b09c-48dd4407c312 response_code = 200 uri = /network-bootstore-config
23242024-11-14T17:00:45.569ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50273
23252024-11-14T17:00:45.569ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50273 req_id = aa44df1e-f996-4088-a886-629b3ad1516a response_code = 200 uri = /baseboard
23262024-11-14T17:00:46.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35640
23272024-11-14T17:00:46.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35640 req_id = f33b6854-cd9f-4a9d-a61c-c0857d4d9e9c response_code = 200 uri = /vpc-routes
23282024-11-14T17:00:46.977ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
23292024-11-14T17:00:46.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35640 req_id = 204a499c-b499-4cea-ab5a-098f3b96db58 response_code = 204 uri = /eip-gateways
23302024-11-14T17:00:47.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60557
23312024-11-14T17:00:47.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60557 req_id = adcc7a57-6a47-4f13-b3b6-8494f573155a response_code = 200 uri = /vpc-routes
23322024-11-14T17:00:47.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49848
23332024-11-14T17:00:47.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49848 req_id = c1a2ce33-5230-44ce-bc3d-47a3fa15774a response_code = 200 uri = /vpc-routes
23342024-11-14T17:00:47.044ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
23352024-11-14T17:00:47.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60557 req_id = 7c1ec33b-ed10-4835-9ae5-d0885c8e1afe response_code = 204 uri = /eip-gateways
23362024-11-14T17:00:47.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60557 req_id = 40025832-9be8-4744-8d66-5741ffa042ef response_code = 204 uri = /vpc-routes
23372024-11-14T17:00:47.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35702
23382024-11-14T17:00:47.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35702 req_id = a23e917d-c4ef-4912-84bc-b6e6cfe2e728 response_code = 200 uri = /v2p
23392024-11-14T17:00:47.075ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48048
23402024-11-14T17:00:47.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48048 req_id = bb08cf54-ae01-4131-a077-bc857cafca54 response_code = 200 uri = /v2p
23412024-11-14T17:00:47.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35640 req_id = acaeb8e3-33fe-4d08-a635-ab3697b1ec4a response_code = 204 uri = /vpc-routes
23422024-11-14T17:00:47.082ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
23432024-11-14T17:00:47.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49848 req_id = e2c78677-0508-4e0a-83e5-baa6fbb5fe37 response_code = 204 uri = /eip-gateways
23442024-11-14T17:00:47.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49848 req_id = e13cf77a-5035-4d8d-a235-814a4b4f6a3c response_code = 204 uri = /vpc-routes
23452024-11-14T17:00:47.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41755
23462024-11-14T17:00:47.113ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23472024-11-14T17:00:47.155ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23482024-11-14T17:00:47.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100578 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41755 req_id = db8db322-b003-4db2-92e3-c8d72408245b response_code = 204 uri = /switch-ports
23492024-11-14T17:00:47.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34110
23502024-11-14T17:00:47.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47090
23512024-11-14T17:00:47.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36228
23522024-11-14T17:00:47.214ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23532024-11-14T17:00:47.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4067 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34110 req_id = 81698e02-33f4-4da8-97ae-0315836a954d response_code = 200 uri = /v2p
23542024-11-14T17:00:47.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41755 req_id = 00f06706-bc96-4749-aa9c-66d22a12d87b response_code = 200 uri = /network-bootstore-config
23552024-11-14T17:00:47.253ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23562024-11-14T17:00:47.312ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23572024-11-14T17:00:47.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97708 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36228 req_id = 6eb22d95-da83-46da-b22a-aefd85dcf691 response_code = 204 uri = /switch-ports
23582024-11-14T17:00:47.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 690 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36228 req_id = d649abb8-0673-4433-b662-1dcc5793e11d response_code = 200 uri = /network-bootstore-config
23592024-11-14T17:00:47.345ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23602024-11-14T17:00:47.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190654 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47090 req_id = 3a9d7aaf-dca2-466e-85bf-e9ae73e55583 response_code = 204 uri = /switch-ports
23612024-11-14T17:00:47.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47090 req_id = e8a27f2d-1e55-4608-b596-f41dbec82454 response_code = 200 uri = /network-bootstore-config
23622024-11-14T17:01:15.601ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60358
23632024-11-14T17:01:15.601ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60358 req_id = d8b47bb6-9ba1-40d8-8d66-0c3b62b4bf88 response_code = 200 uri = /baseboard
23642024-11-14T17:01:17.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48362
23652024-11-14T17:01:17.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48362 req_id = 8216dc83-7aaf-46db-aa0e-9327dbac0891 response_code = 200 uri = /vpc-routes
23662024-11-14T17:01:17.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56675
23672024-11-14T17:01:17.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56675 req_id = c6788ebe-dce0-495a-8905-55b7eb58a078 response_code = 200 uri = /vpc-routes
23682024-11-14T17:01:17.158ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
23692024-11-14T17:01:17.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48362 req_id = 10c2c26c-efa8-4d91-a988-2f8e4f197540 response_code = 204 uri = /eip-gateways
23702024-11-14T17:01:17.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48362 req_id = d30ec779-156c-4927-ac28-d5deadc9bf3c response_code = 204 uri = /vpc-routes
23712024-11-14T17:01:17.176ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
23722024-11-14T17:01:17.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56675 req_id = 823aab8d-e556-4dde-b6a3-ee744ef585fc response_code = 204 uri = /eip-gateways
23732024-11-14T17:01:17.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56675 req_id = 45843b85-7366-4585-8daf-770bff2d5733 response_code = 204 uri = /vpc-routes
23742024-11-14T17:01:17.241ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63601
23752024-11-14T17:01:17.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63601 req_id = 53286642-b252-4f6c-8834-b8eb97ddb53a response_code = 200 uri = /vpc-routes
23762024-11-14T17:01:17.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51063
23772024-11-14T17:01:17.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51063 req_id = ba499b66-fde5-4d66-b61e-683140f703d9 response_code = 200 uri = /v2p
23782024-11-14T17:01:17.254ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34669
23792024-11-14T17:01:17.254ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23802024-11-14T17:01:17.300ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23812024-11-14T17:01:17.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102863 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34669 req_id = 05abf252-3fd3-4010-92d4-b28f7c237306 response_code = 204 uri = /switch-ports
23822024-11-14T17:01:17.357ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60547
23832024-11-14T17:01:17.357ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
23842024-11-14T17:01:17.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63601 req_id = 6909b99e-a4b5-4723-a15d-1fd89c493000 response_code = 204 uri = /eip-gateways
23852024-11-14T17:01:17.357ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59519
23862024-11-14T17:01:17.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34669 req_id = 4654e428-1b2d-47e6-b04b-9508ee3646a1 response_code = 200 uri = /network-bootstore-config
23872024-11-14T17:01:17.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60547 req_id = bc36c433-49f3-4c6e-a401-17e3d3562af0 response_code = 200 uri = /v2p
23882024-11-14T17:01:17.357ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23892024-11-14T17:01:17.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64456
23902024-11-14T17:01:17.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64456 req_id = 171e115e-5ae9-4931-8499-e4f21bfcc924 response_code = 200 uri = /v2p
23912024-11-14T17:01:17.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63601 req_id = d350309b-4799-4953-991c-b8fb6e7d6941 response_code = 204 uri = /vpc-routes
23922024-11-14T17:01:17.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38961
23932024-11-14T17:01:17.399ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23942024-11-14T17:01:17.469ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23952024-11-14T17:01:17.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111717 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59519 req_id = 45fabad6-a826-40d6-84fc-f565e34b0ef1 response_code = 204 uri = /switch-ports
23962024-11-14T17:01:17.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 821 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59519 req_id = 5b59ab76-048a-49bf-8dd4-a2af0acf2bfb response_code = 200 uri = /network-bootstore-config
23972024-11-14T17:01:17.506ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23982024-11-14T17:01:17.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196947 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38961 req_id = 7f1b92cb-2683-4e3e-8c80-e01437801f81 response_code = 204 uri = /switch-ports
23992024-11-14T17:01:17.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38961 req_id = e2ca2631-98a0-47b1-8920-b411da535a01 response_code = 200 uri = /network-bootstore-config
24002024-11-14T17:01:42.336ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24012024-11-14T17:01:42.338ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24022024-11-14T17:01:42.379ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24032024-11-14T17:01:42.381ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24042024-11-14T17:01:42.382ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24052024-11-14T17:01:42.383ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24062024-11-14T17:01:42.383ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24072024-11-14T17:01:42.412ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24082024-11-14T17:01:42.480ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24092024-11-14T17:01:45.632ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65355
24102024-11-14T17:01:45.632ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65355 req_id = 01984834-66d5-44d3-b99d-5f391a3b9fdb response_code = 200 uri = /baseboard
24112024-11-14T17:01:46.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50335
24122024-11-14T17:01:46.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50335 req_id = 58b2e033-5cdc-40c3-8396-b2570e78a40f response_code = 200 uri = /vpc-routes
24132024-11-14T17:01:46.951ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
24142024-11-14T17:01:46.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50335 req_id = b42b1c21-b46b-4978-b3f4-af5b90be0dfe response_code = 204 uri = /eip-gateways
24152024-11-14T17:01:46.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50335 req_id = bae84454-b289-449a-9273-1ed2729399ae response_code = 204 uri = /vpc-routes
24162024-11-14T17:01:46.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33708
24172024-11-14T17:01:46.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33708 req_id = d5aef6d2-238c-4353-8cb8-a3bbafa59e71 response_code = 200 uri = /vpc-routes
24182024-11-14T17:01:47.052ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
24192024-11-14T17:01:47.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33708 req_id = 7c49d2cf-08b0-4071-9572-2ccbbb1fbf94 response_code = 204 uri = /eip-gateways
24202024-11-14T17:01:47.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33708 req_id = 471b1ce0-eaee-4e36-8b14-607e826ec0b3 response_code = 204 uri = /vpc-routes
24212024-11-14T17:01:47.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56540
24222024-11-14T17:01:47.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56540 req_id = ce0ea031-6aab-4c46-9581-47b1aa3d0f29 response_code = 200 uri = /vpc-routes
24232024-11-14T17:01:47.111ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34008
24242024-11-14T17:01:47.111ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24252024-11-14T17:01:47.153ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24262024-11-14T17:01:47.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106191 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34008 req_id = 86f63594-3843-44b7-a944-18df1fc8e117 response_code = 204 uri = /switch-ports
24272024-11-14T17:01:47.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45854
24282024-11-14T17:01:47.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61075
24292024-11-14T17:01:47.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62859
24302024-11-14T17:01:47.218ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
24312024-11-14T17:01:47.218ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24322024-11-14T17:01:47.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56540 req_id = 6a74407f-0ce1-4800-881f-b0f7b208a700 response_code = 204 uri = /eip-gateways
24332024-11-14T17:01:47.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34008 req_id = 7a00535b-2c69-46d8-84fc-270729b91cdd response_code = 200 uri = /network-bootstore-config
24342024-11-14T17:01:47.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61075 req_id = f51de594-c5ec-40bc-baa7-dbc5e25a4aca response_code = 200 uri = /v2p
24352024-11-14T17:01:47.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33711
24362024-11-14T17:01:47.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6577 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62859 req_id = ea1b8a1d-4e58-4ce0-9fbe-7eb050f7806c response_code = 200 uri = /v2p
24372024-11-14T17:01:47.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56540 req_id = ab197a7b-5069-4a44-a56d-e6791abec383 response_code = 204 uri = /vpc-routes
24382024-11-14T17:01:47.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49294
24392024-11-14T17:01:47.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49294 req_id = 49796f99-6d94-4230-8c20-1e35b8a68b7a response_code = 200 uri = /v2p
24402024-11-14T17:01:47.261ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24412024-11-14T17:01:47.322ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24422024-11-14T17:01:47.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104639 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45854 req_id = 673fa832-f682-40ba-b526-51eea62cfa58 response_code = 204 uri = /switch-ports
24432024-11-14T17:01:47.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 726 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45854 req_id = ec7cb5a5-d527-44fb-a0d6-4f40d440f497 response_code = 200 uri = /network-bootstore-config
24442024-11-14T17:01:47.358ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24452024-11-14T17:01:47.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193271 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33711 req_id = 70db935a-a395-4c3b-934a-82dd2e079615 response_code = 204 uri = /switch-ports
24462024-11-14T17:01:47.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33711 req_id = 690ae7e4-fad5-44c5-b10d-d9ed8f638d74 response_code = 200 uri = /network-bootstore-config
24472024-11-14T17:01:52.334ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24482024-11-14T17:01:52.335ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24492024-11-14T17:01:52.336ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24502024-11-14T17:01:52.337ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24512024-11-14T17:01:52.338ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24522024-11-14T17:01:52.339ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24532024-11-14T17:01:52.339ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24542024-11-14T17:01:52.340ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24552024-11-14T17:01:52.341ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24562024-11-14T17:01:52.342ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24572024-11-14T17:01:52.342ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24582024-11-14T17:01:52.381ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24592024-11-14T17:01:52.383ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24602024-11-14T17:01:52.384ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24612024-11-14T17:01:52.384ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24622024-11-14T17:01:52.386ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24632024-11-14T17:01:52.414ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24642024-11-14T17:01:52.483ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24652024-11-14T17:01:54.305ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24662024-11-14T17:01:54.305ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24672024-11-14T17:01:54.338ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 2838, tv_nsec: 68875076 } time_to_next_cleanup = 599.99999662s
24682024-11-14T17:02:02.339ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24692024-11-14T17:02:02.340ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24702024-11-14T17:02:02.341ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24712024-11-14T17:02:02.342ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24722024-11-14T17:02:02.343ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24732024-11-14T17:02:02.343ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24742024-11-14T17:02:02.344ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24752024-11-14T17:02:02.345ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24762024-11-14T17:02:02.346ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24772024-11-14T17:02:02.347ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24782024-11-14T17:02:02.347ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24792024-11-14T17:02:02.382ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24802024-11-14T17:02:02.386ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24812024-11-14T17:02:02.386ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24822024-11-14T17:02:02.387ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24832024-11-14T17:02:02.387ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24842024-11-14T17:02:02.415ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24852024-11-14T17:02:02.486ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24862024-11-14T17:02:09.170ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24872024-11-14T17:02:12.344ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24882024-11-14T17:02:12.345ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24892024-11-14T17:02:12.345ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24902024-11-14T17:02:12.346ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24912024-11-14T17:02:12.347ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24922024-11-14T17:02:12.348ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24932024-11-14T17:02:12.349ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24942024-11-14T17:02:12.350ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24952024-11-14T17:02:12.351ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24962024-11-14T17:02:12.351ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24972024-11-14T17:02:12.352ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24982024-11-14T17:02:12.384ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
24992024-11-14T17:02:12.388ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25002024-11-14T17:02:12.388ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25012024-11-14T17:02:12.389ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25022024-11-14T17:02:12.389ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25032024-11-14T17:02:12.417ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25042024-11-14T17:02:12.492ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25052024-11-14T17:02:15.666ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39392
25062024-11-14T17:02:15.666ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39392 req_id = ae90bfcd-b795-4d74-84c8-11887b63c8d9 response_code = 200 uri = /baseboard
25072024-11-14T17:02:16.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39590
25082024-11-14T17:02:16.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39590 req_id = e8d29282-eefd-4b47-b300-282dfebe75ea response_code = 200 uri = /vpc-routes
25092024-11-14T17:02:17.075ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59612
25102024-11-14T17:02:17.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59612 req_id = 127f5c64-f1e6-4beb-abb4-d3dad28c79b3 response_code = 200 uri = /vpc-routes
25112024-11-14T17:02:17.075ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
25122024-11-14T17:02:17.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39590 req_id = 2b25c8dc-18d1-47c0-98a9-700f7f222d5b response_code = 204 uri = /eip-gateways
25132024-11-14T17:02:17.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52676
25142024-11-14T17:02:17.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52676 req_id = c8942603-e4ff-4095-ad03-7bfb5a68c13d response_code = 200 uri = /vpc-routes
25152024-11-14T17:02:17.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39590 req_id = b3e456f7-5651-4152-9940-cf6a281445f2 response_code = 204 uri = /vpc-routes
25162024-11-14T17:02:17.158ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
25172024-11-14T17:02:17.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59612 req_id = a3e6ff5f-3278-4644-8baa-fe5346a7d091 response_code = 204 uri = /eip-gateways
25182024-11-14T17:02:17.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59612 req_id = 869deaa0-97c1-4a98-90a4-0452a5476e43 response_code = 204 uri = /vpc-routes
25192024-11-14T17:02:17.182ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
25202024-11-14T17:02:17.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52676 req_id = c4740725-25c4-4b8e-912b-dad6dbf185be response_code = 204 uri = /eip-gateways
25212024-11-14T17:02:17.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52676 req_id = 982af6cd-0a36-418b-88f1-775dc702cbbd response_code = 204 uri = /vpc-routes
25222024-11-14T17:02:17.273ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49239
25232024-11-14T17:02:17.273ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25242024-11-14T17:02:17.329ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25252024-11-14T17:02:17.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120357 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49239 req_id = d2aa92f1-4848-4637-98a4-8990343e13a3 response_code = 204 uri = /switch-ports
25262024-11-14T17:02:17.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56238
25272024-11-14T17:02:17.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46096
25282024-11-14T17:02:17.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61894
25292024-11-14T17:02:17.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50180
25302024-11-14T17:02:17.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49239 req_id = 54bf66b6-f36c-4574-839c-e2b2a20b9573 response_code = 200 uri = /network-bootstore-config
25312024-11-14T17:02:17.394ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25322024-11-14T17:02:17.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50180 req_id = 11fdd7cb-9ba9-465d-ab4b-65b048991aff response_code = 200 uri = /v2p
25332024-11-14T17:02:17.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4621 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61894 req_id = 315d114a-7408-4476-86da-ad52128b7a2e response_code = 200 uri = /v2p
25342024-11-14T17:02:17.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4765 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56238 req_id = 083b578e-4968-4757-93e1-d89e79966a43 response_code = 200 uri = /v2p
25352024-11-14T17:02:17.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53419
25362024-11-14T17:02:17.439ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25372024-11-14T17:02:17.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110828 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46096 req_id = e16cf60c-dfbf-4047-a810-785cd8638265 response_code = 204 uri = /switch-ports
25382024-11-14T17:02:17.508ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25392024-11-14T17:02:17.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 617 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46096 req_id = 33170727-eb3c-457d-8075-a86f9175ca2e response_code = 200 uri = /network-bootstore-config
25402024-11-14T17:02:17.542ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25412024-11-14T17:02:17.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188487 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53419 req_id = e09ea9d5-06b9-4cfb-bbb8-3f2755d440ea response_code = 204 uri = /switch-ports
25422024-11-14T17:02:17.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53419 req_id = f3f850d9-b5ed-4de1-845a-a9466608276a response_code = 200 uri = /network-bootstore-config
25432024-11-14T17:02:22.348ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25442024-11-14T17:02:22.349ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25452024-11-14T17:02:22.350ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25462024-11-14T17:02:22.351ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25472024-11-14T17:02:22.352ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25482024-11-14T17:02:22.353ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25492024-11-14T17:02:22.354ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25502024-11-14T17:02:22.355ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25512024-11-14T17:02:22.355ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25522024-11-14T17:02:22.356ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25532024-11-14T17:02:22.356ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25542024-11-14T17:02:22.385ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25552024-11-14T17:02:22.389ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25562024-11-14T17:02:22.391ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25572024-11-14T17:02:22.391ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25582024-11-14T17:02:22.392ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25592024-11-14T17:02:22.418ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25602024-11-14T17:02:22.494ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25612024-11-14T17:02:32.353ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25622024-11-14T17:02:32.354ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25632024-11-14T17:02:32.355ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25642024-11-14T17:02:32.355ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25652024-11-14T17:02:32.357ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25662024-11-14T17:02:32.358ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25672024-11-14T17:02:32.358ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25682024-11-14T17:02:32.360ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25692024-11-14T17:02:32.360ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25702024-11-14T17:02:32.361ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25712024-11-14T17:02:32.361ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25722024-11-14T17:02:32.387ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25732024-11-14T17:02:32.391ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25742024-11-14T17:02:32.392ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25752024-11-14T17:02:32.393ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25762024-11-14T17:02:32.393ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25772024-11-14T17:02:32.421ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25782024-11-14T17:02:32.496ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25792024-11-14T17:02:42.356ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25802024-11-14T17:02:42.357ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25812024-11-14T17:02:42.358ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25822024-11-14T17:02:42.359ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25832024-11-14T17:02:42.360ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25842024-11-14T17:02:42.361ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25852024-11-14T17:02:42.361ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25862024-11-14T17:02:42.362ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25872024-11-14T17:02:42.363ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25882024-11-14T17:02:42.364ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25892024-11-14T17:02:42.364ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25902024-11-14T17:02:42.389ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25912024-11-14T17:02:42.393ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25922024-11-14T17:02:42.394ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25932024-11-14T17:02:42.394ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25942024-11-14T17:02:42.395ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25952024-11-14T17:02:42.422ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25962024-11-14T17:02:42.499ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
25972024-11-14T17:02:45.701ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45259
25982024-11-14T17:02:45.701ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45259 req_id = 2b92b0af-2b54-407b-ba42-42ede076c498 response_code = 200 uri = /baseboard
25992024-11-14T17:02:46.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43517
26002024-11-14T17:02:46.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43517 req_id = a146a212-1651-40c0-abf5-85f51b9ea910 response_code = 200 uri = /vpc-routes
26012024-11-14T17:02:47.011ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
26022024-11-14T17:02:47.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43517 req_id = 0b11003c-5c86-4f76-973e-3c0be2a80f29 response_code = 204 uri = /eip-gateways
26032024-11-14T17:02:47.018ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65030
26042024-11-14T17:02:47.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65030 req_id = 413bffba-c665-4cd6-a4ba-dd0670e3094d response_code = 200 uri = /vpc-routes
26052024-11-14T17:02:47.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43517 req_id = 44dc057e-6b1d-4439-98b2-89799096fcda response_code = 204 uri = /vpc-routes
26062024-11-14T17:02:47.051ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55042
26072024-11-14T17:02:47.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55042 req_id = 39025afb-7ca3-4c8e-82ef-246268915ad7 response_code = 200 uri = /v2p
26082024-11-14T17:02:47.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54550
26092024-11-14T17:02:47.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54550 req_id = 776d23f6-1469-4ded-ba53-cb230824575a response_code = 200 uri = /vpc-routes
26102024-11-14T17:02:47.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45460
26112024-11-14T17:02:47.057ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26122024-11-14T17:02:47.104ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26132024-11-14T17:02:47.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113579 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45460 req_id = 4432c5d9-63c1-4a8f-85cb-aa68b6f09866 response_code = 204 uri = /switch-ports
26142024-11-14T17:02:47.171ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
26152024-11-14T17:02:47.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54550 req_id = 98dbcedc-d0a8-4f0c-b72e-7174dac3f2c3 response_code = 204 uri = /eip-gateways
26162024-11-14T17:02:47.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40388
26172024-11-14T17:02:47.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54643
26182024-11-14T17:02:47.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56392
26192024-11-14T17:02:47.171ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
26202024-11-14T17:02:47.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35388
26212024-11-14T17:02:47.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65030 req_id = 313f6863-c2cc-4e0d-a3fd-58aaf83c8d25 response_code = 204 uri = /eip-gateways
26222024-11-14T17:02:47.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45460 req_id = 11bbd8cf-3d40-498d-a86f-a3bb0dd9f536 response_code = 200 uri = /network-bootstore-config
26232024-11-14T17:02:47.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40388 req_id = 4a27409d-2cb6-47b7-9b33-6b6c8c0efba8 response_code = 200 uri = /v2p
26242024-11-14T17:02:47.172ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26252024-11-14T17:02:47.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56392 req_id = 0df5d85e-08eb-47fe-a513-f234d649a06d response_code = 200 uri = /v2p
26262024-11-14T17:02:47.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 367 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65030 req_id = d6c38e25-dda8-4d60-a383-9028281e3e48 response_code = 204 uri = /vpc-routes
26272024-11-14T17:02:47.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54550 req_id = 8a225418-525a-4da3-9217-861de6e6a0c9 response_code = 204 uri = /vpc-routes
26282024-11-14T17:02:47.213ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26292024-11-14T17:02:47.268ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26302024-11-14T17:02:47.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96187 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54643 req_id = ec7196b4-e90c-4f7a-8e41-a8ffb8abd83f response_code = 204 uri = /switch-ports
26312024-11-14T17:02:47.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54643 req_id = abf4ab46-2d9c-4c24-aa2b-3752568d714c response_code = 200 uri = /network-bootstore-config
26322024-11-14T17:02:47.306ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26332024-11-14T17:02:47.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192284 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35388 req_id = f7bb024e-3d46-48a0-9030-d2ac9e4b1574 response_code = 204 uri = /switch-ports
26342024-11-14T17:02:47.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35388 req_id = d30451dc-4a6a-468f-89a3-8d0c2bad5624 response_code = 200 uri = /network-bootstore-config
26352024-11-14T17:02:52.361ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26362024-11-14T17:02:52.362ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26372024-11-14T17:02:52.363ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26382024-11-14T17:02:52.363ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26392024-11-14T17:02:52.365ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26402024-11-14T17:02:52.365ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26412024-11-14T17:02:52.366ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26422024-11-14T17:02:52.367ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26432024-11-14T17:02:52.368ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26442024-11-14T17:02:52.369ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26452024-11-14T17:02:52.369ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26462024-11-14T17:02:52.398ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26472024-11-14T17:02:52.399ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26482024-11-14T17:02:52.400ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26492024-11-14T17:02:52.401ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26502024-11-14T17:02:52.402ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26512024-11-14T17:02:52.424ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26522024-11-14T17:02:52.503ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26532024-11-14T17:03:02.365ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26542024-11-14T17:03:02.365ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26552024-11-14T17:03:02.366ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26562024-11-14T17:03:02.367ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26572024-11-14T17:03:02.368ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26582024-11-14T17:03:02.369ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26592024-11-14T17:03:02.369ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26602024-11-14T17:03:02.370ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26612024-11-14T17:03:02.371ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26622024-11-14T17:03:02.372ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26632024-11-14T17:03:02.372ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26642024-11-14T17:03:02.400ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26652024-11-14T17:03:02.400ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26662024-11-14T17:03:02.402ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26672024-11-14T17:03:02.402ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26682024-11-14T17:03:02.404ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26692024-11-14T17:03:02.425ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26702024-11-14T17:03:02.506ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26712024-11-14T17:03:12.368ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26722024-11-14T17:03:12.369ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26732024-11-14T17:03:12.370ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26742024-11-14T17:03:12.371ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26752024-11-14T17:03:12.372ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26762024-11-14T17:03:12.373ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26772024-11-14T17:03:12.373ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26782024-11-14T17:03:12.374ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26792024-11-14T17:03:12.375ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26802024-11-14T17:03:12.376ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26812024-11-14T17:03:12.376ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26822024-11-14T17:03:12.402ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26832024-11-14T17:03:12.402ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26842024-11-14T17:03:12.404ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26852024-11-14T17:03:12.404ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26862024-11-14T17:03:12.406ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26872024-11-14T17:03:12.427ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26882024-11-14T17:03:12.508ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
26892024-11-14T17:03:15.747ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58610
26902024-11-14T17:03:15.747ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58610 req_id = 8268feac-0b7f-4731-a679-e50a023adaee response_code = 200 uri = /baseboard
26912024-11-14T17:03:17.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52021
26922024-11-14T17:03:17.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52021 req_id = 72628fd1-a82b-404f-bfbe-d9fb3eea01c8 response_code = 200 uri = /vpc-routes
26932024-11-14T17:03:17.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34175
26942024-11-14T17:03:17.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34175 req_id = f78e2140-bc84-4530-b54f-78855fe724d7 response_code = 200 uri = /vpc-routes
26952024-11-14T17:03:17.181ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
26962024-11-14T17:03:17.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52021 req_id = 5b5c5d84-9e9e-43aa-a944-1f96324e4f32 response_code = 204 uri = /eip-gateways
26972024-11-14T17:03:17.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52021 req_id = de296cb0-3fe1-47dd-b1f3-b45042c94854 response_code = 204 uri = /vpc-routes
26982024-11-14T17:03:17.238ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
26992024-11-14T17:03:17.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34175 req_id = b5b6e35b-2c2c-4211-9dd3-b5cf32fd8be2 response_code = 204 uri = /eip-gateways
27002024-11-14T17:03:17.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57578
27012024-11-14T17:03:17.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57578 req_id = b9dec1d3-f995-4df4-abf8-4374a26c18f0 response_code = 200 uri = /v2p
27022024-11-14T17:03:17.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34175 req_id = dbb74453-7314-4623-bfd9-e6efd17c5ec2 response_code = 204 uri = /vpc-routes
27032024-11-14T17:03:17.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54328
27042024-11-14T17:03:17.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54328 req_id = a662d62c-caa3-4592-bbf9-241df03ffb55 response_code = 200 uri = /v2p
27052024-11-14T17:03:17.371ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37325
27062024-11-14T17:03:17.371ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27072024-11-14T17:03:17.426ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27082024-11-14T17:03:17.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148623 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37325 req_id = 41cb1ce9-ea6d-4941-85b5-b5d4f9601001 response_code = 204 uri = /switch-ports
27092024-11-14T17:03:17.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48659
27102024-11-14T17:03:17.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54034
27112024-11-14T17:03:17.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50939
27122024-11-14T17:03:17.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53055
27132024-11-14T17:03:17.520ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27142024-11-14T17:03:17.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48659 req_id = 80bebe5b-1bab-4684-89b6-c45682be28a4 response_code = 200 uri = /vpc-routes
27152024-11-14T17:03:17.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 401 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37325 req_id = 76656293-3d98-4756-931e-37d5e0af592c response_code = 200 uri = /network-bootstore-config
27162024-11-14T17:03:17.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7733 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50939 req_id = 8542a017-7aa0-4813-b086-2b3b9c29788e response_code = 200 uri = /v2p
27172024-11-14T17:03:17.581ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27182024-11-14T17:03:17.590ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
27192024-11-14T17:03:17.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48659 req_id = 2cc3f686-d8a4-4bc2-808e-d40726f3ef97 response_code = 204 uri = /eip-gateways
27202024-11-14T17:03:17.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 690 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48659 req_id = 6f809db0-aeaf-447d-8bad-2c85271b11da response_code = 204 uri = /vpc-routes
27212024-11-14T17:03:17.677ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27222024-11-14T17:03:17.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156647 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53055 req_id = a4ec071e-176a-4d52-af8a-36192f2e6220 response_code = 204 uri = /switch-ports
27232024-11-14T17:03:17.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 732 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53055 req_id = 1df6d24f-f2dc-4a5c-8508-f4162c1d4ea7 response_code = 200 uri = /network-bootstore-config
27242024-11-14T17:03:17.721ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27252024-11-14T17:03:17.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269039 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54034 req_id = 36699820-1531-46fa-8fa3-863caf085b43 response_code = 204 uri = /switch-ports
27262024-11-14T17:03:17.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54034 req_id = dcdb63bb-b58d-4b98-b5e4-419d51d737ad response_code = 200 uri = /network-bootstore-config
27272024-11-14T17:03:22.372ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27282024-11-14T17:03:22.373ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27292024-11-14T17:03:22.374ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27302024-11-14T17:03:22.374ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27312024-11-14T17:03:22.376ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27322024-11-14T17:03:22.376ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27332024-11-14T17:03:22.377ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27342024-11-14T17:03:22.378ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27352024-11-14T17:03:22.379ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27362024-11-14T17:03:22.379ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27372024-11-14T17:03:22.380ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27382024-11-14T17:03:22.404ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27392024-11-14T17:03:22.404ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27402024-11-14T17:03:22.406ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27412024-11-14T17:03:22.406ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27422024-11-14T17:03:22.408ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27432024-11-14T17:03:22.429ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27442024-11-14T17:03:22.511ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27452024-11-14T17:03:32.376ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27462024-11-14T17:03:32.377ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27472024-11-14T17:03:32.377ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27482024-11-14T17:03:32.378ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27492024-11-14T17:03:32.379ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27502024-11-14T17:03:32.380ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27512024-11-14T17:03:32.381ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27522024-11-14T17:03:32.382ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27532024-11-14T17:03:32.382ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27542024-11-14T17:03:32.383ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27552024-11-14T17:03:32.384ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27562024-11-14T17:03:32.405ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27572024-11-14T17:03:32.406ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27582024-11-14T17:03:32.408ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27592024-11-14T17:03:32.408ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27602024-11-14T17:03:32.409ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27612024-11-14T17:03:32.431ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27622024-11-14T17:03:32.514ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27632024-11-14T17:03:42.380ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27642024-11-14T17:03:42.381ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27652024-11-14T17:03:42.381ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27662024-11-14T17:03:42.382ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27672024-11-14T17:03:42.383ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27682024-11-14T17:03:42.384ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27692024-11-14T17:03:42.384ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27702024-11-14T17:03:42.386ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27712024-11-14T17:03:42.386ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27722024-11-14T17:03:42.387ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27732024-11-14T17:03:42.387ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27742024-11-14T17:03:42.407ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27752024-11-14T17:03:42.408ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27762024-11-14T17:03:42.409ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27772024-11-14T17:03:42.410ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27782024-11-14T17:03:42.410ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27792024-11-14T17:03:42.433ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27802024-11-14T17:03:42.517ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
27812024-11-14T17:03:45.782ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63779
27822024-11-14T17:03:45.782ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63779 req_id = af9870d5-1de3-4bce-bc98-abc8e8355b7b response_code = 200 uri = /baseboard
27832024-11-14T17:03:46.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44653
27842024-11-14T17:03:46.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44653 req_id = 326299a3-9860-48fc-855a-58f000381fc4 response_code = 200 uri = /vpc-routes
27852024-11-14T17:03:46.945ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
27862024-11-14T17:03:46.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44653 req_id = 2e95ee92-fde3-42de-9b9c-028a17106726 response_code = 204 uri = /eip-gateways
27872024-11-14T17:03:46.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44653 req_id = 3908a415-3e1c-4514-a9c2-2855efe52784 response_code = 204 uri = /vpc-routes
27882024-11-14T17:03:47.027ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37251
27892024-11-14T17:03:47.027ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27902024-11-14T17:03:47.077ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27912024-11-14T17:03:47.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125561 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37251 req_id = 98debab5-d364-48fa-9e27-85fa58ee2061 response_code = 204 uri = /switch-ports
27922024-11-14T17:03:47.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58131
27932024-11-14T17:03:47.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36336
27942024-11-14T17:03:47.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33587
27952024-11-14T17:03:47.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37251 req_id = 289dc49c-3625-4f55-92ad-e6727eec5acc response_code = 200 uri = /network-bootstore-config
27962024-11-14T17:03:47.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53014
27972024-11-14T17:03:47.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53014 req_id = c2e53ca4-45ec-4633-ba0a-ae6d9a89be80 response_code = 200 uri = /vpc-routes
27982024-11-14T17:03:47.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33587 req_id = a6e42030-d6f4-427c-a3ac-c0ac077fd100 response_code = 200 uri = /v2p
27992024-11-14T17:03:47.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58131 req_id = 9baa223e-b3eb-4d66-a3a0-6af4d912f12c response_code = 200 uri = /v2p
28002024-11-14T17:03:47.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36336 req_id = 3d505633-bd70-4dfe-8816-a6d00b84bc5f response_code = 200 uri = /vpc-routes
28012024-11-14T17:03:47.165ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46816
28022024-11-14T17:03:47.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46816 req_id = 8a59eef9-df4f-43b9-9875-069fcb416c54 response_code = 200 uri = /v2p
28032024-11-14T17:03:47.175ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
28042024-11-14T17:03:47.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36336 req_id = 77ee93b3-d83c-4b32-bfb6-c8acfa2c0d19 response_code = 204 uri = /eip-gateways
28052024-11-14T17:03:47.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61558
28062024-11-14T17:03:47.185ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28072024-11-14T17:03:47.242ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28082024-11-14T17:03:47.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137945 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61558 req_id = fcbe404b-be1f-4bc4-b805-95f9a8a20057 response_code = 204 uri = /switch-ports
28092024-11-14T17:03:47.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44368
28102024-11-14T17:03:47.324ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
28112024-11-14T17:03:47.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53014 req_id = 1565fdc7-44f6-432f-8b4e-28662404e78e response_code = 204 uri = /eip-gateways
28122024-11-14T17:03:47.324ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28132024-11-14T17:03:47.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61558 req_id = 79a69952-5d44-4374-b798-94097e863b15 response_code = 200 uri = /network-bootstore-config
28142024-11-14T17:03:47.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8633 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36336 req_id = 1b2ae188-da91-4ff4-8786-45487766a7c7 response_code = 204 uri = /vpc-routes
28152024-11-14T17:03:47.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53014 req_id = d099801b-3e64-4bf4-a4df-438c1558bb0a response_code = 204 uri = /vpc-routes
28162024-11-14T17:03:47.370ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28172024-11-14T17:03:47.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123360 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44368 req_id = 76a8074e-a243-4a33-830e-91eb8c17e530 response_code = 204 uri = /switch-ports
28182024-11-14T17:03:47.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44368 req_id = aa560b4e-4d62-446c-890a-3f1e51f77f10 response_code = 200 uri = /network-bootstore-config
28192024-11-14T17:03:52.384ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28202024-11-14T17:03:52.385ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28212024-11-14T17:03:52.386ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28222024-11-14T17:03:52.387ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28232024-11-14T17:03:52.388ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28242024-11-14T17:03:52.388ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28252024-11-14T17:03:52.389ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28262024-11-14T17:03:52.390ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28272024-11-14T17:03:52.391ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28282024-11-14T17:03:52.391ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28292024-11-14T17:03:52.392ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28302024-11-14T17:03:52.409ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28312024-11-14T17:03:52.409ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28322024-11-14T17:03:52.411ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28332024-11-14T17:03:52.411ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28342024-11-14T17:03:52.412ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28352024-11-14T17:03:52.435ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28362024-11-14T17:03:52.519ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28372024-11-14T17:04:02.389ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28382024-11-14T17:04:02.390ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28392024-11-14T17:04:02.390ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28402024-11-14T17:04:02.391ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28412024-11-14T17:04:02.392ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28422024-11-14T17:04:02.393ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28432024-11-14T17:04:02.393ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28442024-11-14T17:04:02.395ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28452024-11-14T17:04:02.395ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28462024-11-14T17:04:02.396ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28472024-11-14T17:04:02.396ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28482024-11-14T17:04:02.410ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28492024-11-14T17:04:02.411ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28502024-11-14T17:04:02.412ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28512024-11-14T17:04:02.413ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28522024-11-14T17:04:02.414ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28532024-11-14T17:04:02.437ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28542024-11-14T17:04:02.522ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28552024-11-14T17:04:12.393ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28562024-11-14T17:04:12.394ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28572024-11-14T17:04:12.394ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28582024-11-14T17:04:12.395ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28592024-11-14T17:04:12.396ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28602024-11-14T17:04:12.397ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28612024-11-14T17:04:12.398ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28622024-11-14T17:04:12.399ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28632024-11-14T17:04:12.399ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28642024-11-14T17:04:12.400ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28652024-11-14T17:04:12.401ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28662024-11-14T17:04:12.412ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28672024-11-14T17:04:12.413ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28682024-11-14T17:04:12.414ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28692024-11-14T17:04:12.415ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28702024-11-14T17:04:12.416ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28712024-11-14T17:04:12.439ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28722024-11-14T17:04:12.524ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
28732024-11-14T17:04:15.815ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34903
28742024-11-14T17:04:15.815ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34903 req_id = 02f490c4-2e63-4e48-8bcb-73cc73a29b0e response_code = 200 uri = /baseboard
28752024-11-14T17:04:17.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56403
28762024-11-14T17:04:17.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56403 req_id = 7e20e8c8-f62a-45d4-9483-dd12b1890dd7 response_code = 200 uri = /vpc-routes
28772024-11-14T17:04:17.301ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
28782024-11-14T17:04:17.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56403 req_id = 4e70950a-23ac-48b7-84d2-8cfafc9ac02e response_code = 204 uri = /eip-gateways
28792024-11-14T17:04:17.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57476
28802024-11-14T17:04:17.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57476 req_id = 7cb3c7e3-b7b1-4c1d-af28-adb4cadc9e73 response_code = 200 uri = /vpc-routes
28812024-11-14T17:04:17.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56403 req_id = b9d0cae7-51b3-412c-86b8-cc4a2638c419 response_code = 204 uri = /vpc-routes
28822024-11-14T17:04:17.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39621
28832024-11-14T17:04:17.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39621 req_id = 55a32d38-486e-4942-9c78-91e37e257d21 response_code = 200 uri = /vpc-routes
28842024-11-14T17:04:17.368ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
28852024-11-14T17:04:17.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57476 req_id = 01e19eb0-ad78-445d-9338-3e13b1708c9b response_code = 204 uri = /eip-gateways
28862024-11-14T17:04:17.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48951
28872024-11-14T17:04:17.392ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28882024-11-14T17:04:17.392ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28892024-11-14T17:04:17.392ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/omicron-zones.json file = common/src/ledger.rs:177
28902024-11-14T17:04:17.392ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/omicron-zones.json file = common/src/ledger.rs:177
28912024-11-14T17:04:17.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64000
28922024-11-14T17:04:17.403ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28932024-11-14T17:04:17.409ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28942024-11-14T17:04:17.409ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da94b0fc-e114-4d62-8eee-1f3b839145a7
28952024-11-14T17:04:17.417ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
28962024-11-14T17:04:17.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 740 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39621 req_id = 6eaef9a7-c084-457d-abae-310ef26f58a7 response_code = 204 uri = /eip-gateways
28972024-11-14T17:04:17.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49727
28982024-11-14T17:04:17.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49727 req_id = 1a90fbbc-63d9-4d29-a5db-361c9aa995eb response_code = 200 uri = /v2p
28992024-11-14T17:04:17.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 898 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57476 req_id = 1816f861-6acf-41a1-bf47-32e2446a6b26 response_code = 204 uri = /vpc-routes
29002024-11-14T17:04:17.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44744
29012024-11-14T17:04:17.441ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29022024-11-14T17:04:17.441ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29032024-11-14T17:04:17.441ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/omicron-zones.json file = common/src/ledger.rs:177
29042024-11-14T17:04:17.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63467
29052024-11-14T17:04:17.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63467 req_id = d0088813-37d8-434f-acb9-42edcc1fb9e3 response_code = 200 uri = /v2p
29062024-11-14T17:04:17.442ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/omicron-zones.json file = common/src/ledger.rs:177
29072024-11-14T17:04:17.447ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29082024-11-14T17:04:17.448ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0e37ddab-daec-4c38-a903-78b351e48433
29092024-11-14T17:04:17.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48889
29102024-11-14T17:04:17.453ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29112024-11-14T17:04:17.466ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29122024-11-14T17:04:17.466ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da94b0fc-e114-4d62-8eee-1f3b839145a7
29132024-11-14T17:04:17.488ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29142024-11-14T17:04:17.488ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a47fbfc2-afec-46c8-bc5a-f6c02b232d2e
29152024-11-14T17:04:17.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61506
29162024-11-14T17:04:17.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60397
29172024-11-14T17:04:17.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60397 req_id = 9222c53d-e0db-4508-9284-f1e7a7127f55 response_code = 200 uri = /v2p
29182024-11-14T17:04:17.507ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29192024-11-14T17:04:17.507ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0e37ddab-daec-4c38-a903-78b351e48433
29202024-11-14T17:04:17.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6558 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39621 req_id = 1aafc5d7-2ca8-4f49-9ab2-05b871d82807 response_code = 204 uri = /vpc-routes
29212024-11-14T17:04:17.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61429
29222024-11-14T17:04:17.525ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29232024-11-14T17:04:17.525ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29242024-11-14T17:04:17.525ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/config/omicron-zones.json file = common/src/ledger.rs:177
29252024-11-14T17:04:17.541ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29262024-11-14T17:04:17.541ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e573afbb-ee4c-4f2d-9d08-b65b7fca29cf
29272024-11-14T17:04:17.541ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/config/omicron-zones.json file = common/src/ledger.rs:177
29282024-11-14T17:04:17.555ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29292024-11-14T17:04:17.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152067 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64000 req_id = 780af0f2-856d-41e3-aa21-b7979435452c response_code = 204 uri = /switch-ports
29302024-11-14T17:04:17.562ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29312024-11-14T17:04:17.562ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a47fbfc2-afec-46c8-bc5a-f6c02b232d2e
29322024-11-14T17:04:17.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5622 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64000 req_id = 18f03c0c-e18e-4314-b05c-a64435f1617b response_code = 200 uri = /network-bootstore-config
29332024-11-14T17:04:17.578ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da94b0fc-e114-4d62-8eee-1f3b839145a7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29342024-11-14T17:04:17.578ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_da94b0fc-e114-4d62-8eee-1f3b839145a7
29352024-11-14T17:04:17.600ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29362024-11-14T17:04:17.600ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_63c85555-7e85-4f53-92b1-afc3cd212893
29372024-11-14T17:04:17.604ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29382024-11-14T17:04:17.608ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38596
29392024-11-14T17:04:17.615ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 50069af6-9491-4754-9535-843738a189a5, kind: Service { id: cb30b954-f678-488f-bf13-6a751f361b3f }, name: Name("external-dns-cb30b954-f678-488f-bf13-6a751f361b3f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 18])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e993830-3c47-4e8c-8d42-eec7a6d6efc3, kind: Service { id: 94482e71-9503-4d09-b73f-615fbf343a2e }, name: Name("external-dns-94482e71-9503-4d09-b73f-615fbf343a2e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 30bff459-835e-497d-90ea-b8f3054087c8, kind: Service { id: ce02c1f9-750d-466c-8882-9fa4058550a9 }, name: Name("nexus-ce02c1f9-750d-466c-8882-9fa4058550a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbccdcee-328d-46b4-80f2-6e0f18d211c8, kind: Service { id: 0cc022d1-76d3-4a28-8e75-e8e958faa197 }, name: Name("nexus-0cc022d1-76d3-4a28-8e75-e8e958faa197"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 39])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e712bb0a-d063-491f-bbf4-5dc66991d2fe, kind: Service { id: 2b0034bc-df6c-49bf-ba55-680c74f1cd4c }, name: Name("nexus-2b0034bc-df6c-49bf-ba55-680c74f1cd4c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 214])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
29402024-11-14T17:04:17.615ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29412024-11-14T17:04:17.615ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
29422024-11-14T17:04:17.615ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29432024-11-14T17:04:17.615ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29442024-11-14T17:04:17.615ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29452024-11-14T17:04:17.615ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29462024-11-14T17:04:17.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 804 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38596 req_id = 59d4a498-c4e3-4f08-b551-95945a5c2cd9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
29472024-11-14T17:04:17.619ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29482024-11-14T17:04:17.619ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e573afbb-ee4c-4f2d-9d08-b65b7fca29cf
29492024-11-14T17:04:17.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53801
29502024-11-14T17:04:17.635ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 50069af6-9491-4754-9535-843738a189a5, kind: Service { id: cb30b954-f678-488f-bf13-6a751f361b3f }, name: Name("external-dns-cb30b954-f678-488f-bf13-6a751f361b3f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 18])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e993830-3c47-4e8c-8d42-eec7a6d6efc3, kind: Service { id: 94482e71-9503-4d09-b73f-615fbf343a2e }, name: Name("external-dns-94482e71-9503-4d09-b73f-615fbf343a2e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 30bff459-835e-497d-90ea-b8f3054087c8, kind: Service { id: ce02c1f9-750d-466c-8882-9fa4058550a9 }, name: Name("nexus-ce02c1f9-750d-466c-8882-9fa4058550a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbccdcee-328d-46b4-80f2-6e0f18d211c8, kind: Service { id: 0cc022d1-76d3-4a28-8e75-e8e958faa197 }, name: Name("nexus-0cc022d1-76d3-4a28-8e75-e8e958faa197"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 39])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e712bb0a-d063-491f-bbf4-5dc66991d2fe, kind: Service { id: 2b0034bc-df6c-49bf-ba55-680c74f1cd4c }, name: Name("nexus-2b0034bc-df6c-49bf-ba55-680c74f1cd4c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 214])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
29512024-11-14T17:04:17.635ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29522024-11-14T17:04:17.635ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
29532024-11-14T17:04:17.635ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29542024-11-14T17:04:17.635ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29552024-11-14T17:04:17.635ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29562024-11-14T17:04:17.635ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29572024-11-14T17:04:17.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 669 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53801 req_id = 09f66ff3-16ca-42d5-89ce-ea7c990bb0a7 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
29582024-11-14T17:04:17.639ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8fbbea6c-76df-4af7-a25f-3e2c165ad855 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29592024-11-14T17:04:17.639ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8fbbea6c-76df-4af7-a25f-3e2c165ad855
29602024-11-14T17:04:17.654ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0e37ddab-daec-4c38-a903-78b351e48433 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29612024-11-14T17:04:17.654ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0e37ddab-daec-4c38-a903-78b351e48433
29622024-11-14T17:04:17.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63659
29632024-11-14T17:04:17.677ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29642024-11-14T17:04:17.677ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_63c85555-7e85-4f53-92b1-afc3cd212893
29652024-11-14T17:04:17.687ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 50069af6-9491-4754-9535-843738a189a5, kind: Service { id: cb30b954-f678-488f-bf13-6a751f361b3f }, name: Name("external-dns-cb30b954-f678-488f-bf13-6a751f361b3f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 18])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e993830-3c47-4e8c-8d42-eec7a6d6efc3, kind: Service { id: 94482e71-9503-4d09-b73f-615fbf343a2e }, name: Name("external-dns-94482e71-9503-4d09-b73f-615fbf343a2e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 30bff459-835e-497d-90ea-b8f3054087c8, kind: Service { id: ce02c1f9-750d-466c-8882-9fa4058550a9 }, name: Name("nexus-ce02c1f9-750d-466c-8882-9fa4058550a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbccdcee-328d-46b4-80f2-6e0f18d211c8, kind: Service { id: 0cc022d1-76d3-4a28-8e75-e8e958faa197 }, name: Name("nexus-0cc022d1-76d3-4a28-8e75-e8e958faa197"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 39])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e712bb0a-d063-491f-bbf4-5dc66991d2fe, kind: Service { id: 2b0034bc-df6c-49bf-ba55-680c74f1cd4c }, name: Name("nexus-2b0034bc-df6c-49bf-ba55-680c74f1cd4c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 214])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
29662024-11-14T17:04:17.687ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29672024-11-14T17:04:17.687ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
29682024-11-14T17:04:17.687ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29692024-11-14T17:04:17.687ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29702024-11-14T17:04:17.687ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29712024-11-14T17:04:17.687ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29722024-11-14T17:04:17.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5856 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63659 req_id = b88439f0-d471-44ce-ac72-4e1d92472b53 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
29732024-11-14T17:04:17.692ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29742024-11-14T17:04:17.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233037 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48889 req_id = 665837c5-1dcd-4513-8942-b627e2897c75 response_code = 204 uri = /switch-ports
29752024-11-14T17:04:17.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 589 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48889 req_id = bbe80396-2d13-454a-ad5e-d9d88cbb7b53 response_code = 200 uri = /network-bootstore-config
29762024-11-14T17:04:17.697ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a47fbfc2-afec-46c8-bc5a-f6c02b232d2e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29772024-11-14T17:04:17.697ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a47fbfc2-afec-46c8-bc5a-f6c02b232d2e
29782024-11-14T17:04:17.711ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29792024-11-14T17:04:17.711ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad871e3f-9a86-4a01-ac75-964bae58e4aa
29802024-11-14T17:04:17.729ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8fbbea6c-76df-4af7-a25f-3e2c165ad855 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29812024-11-14T17:04:17.729ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8fbbea6c-76df-4af7-a25f-3e2c165ad855
29822024-11-14T17:04:17.734ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29832024-11-14T17:04:17.747ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f3390b76-1a47-437d-b003-6296b24d9932 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29842024-11-14T17:04:17.747ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f3390b76-1a47-437d-b003-6296b24d9932
29852024-11-14T17:04:17.761ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e573afbb-ee4c-4f2d-9d08-b65b7fca29cf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29862024-11-14T17:04:17.761ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e573afbb-ee4c-4f2d-9d08-b65b7fca29cf
29872024-11-14T17:04:17.778ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29882024-11-14T17:04:17.779ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad871e3f-9a86-4a01-ac75-964bae58e4aa
29892024-11-14T17:04:17.796ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 63c85555-7e85-4f53-92b1-afc3cd212893 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29902024-11-14T17:04:17.796ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_63c85555-7e85-4f53-92b1-afc3cd212893
29912024-11-14T17:04:17.810ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29922024-11-14T17:04:17.810ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c
29932024-11-14T17:04:17.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293994 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61429 req_id = 6648098e-cd60-4a63-9724-71ded2f2c850 response_code = 204 uri = /switch-ports
29942024-11-14T17:04:17.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 666 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61429 req_id = 76a7c0e8-de13-4874-9f05-0cca84c4a016 response_code = 200 uri = /network-bootstore-config
29952024-11-14T17:04:17.828ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f3390b76-1a47-437d-b003-6296b24d9932 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29962024-11-14T17:04:17.828ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f3390b76-1a47-437d-b003-6296b24d9932
29972024-11-14T17:04:17.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 441319 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48951 req_id = dd1280e7-4b30-4c6f-b9d2-4c526bc28292 response_code = 200 uri = /inventory
29982024-11-14T17:04:17.842ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8fbbea6c-76df-4af7-a25f-3e2c165ad855 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29992024-11-14T17:04:17.842ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8fbbea6c-76df-4af7-a25f-3e2c165ad855
30002024-11-14T17:04:17.865ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad871e3f-9a86-4a01-ac75-964bae58e4aa (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
30012024-11-14T17:04:17.866ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad871e3f-9a86-4a01-ac75-964bae58e4aa
30022024-11-14T17:04:17.879ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
30032024-11-14T17:04:17.879ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c
30042024-11-14T17:04:17.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 451956 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44744 req_id = 6bfbb25d-6763-4843-bae1-2eb05c6286ba response_code = 200 uri = /inventory
30052024-11-14T17:04:17.894ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f3390b76-1a47-437d-b003-6296b24d9932 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
30062024-11-14T17:04:17.894ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f3390b76-1a47-437d-b003-6296b24d9932
30072024-11-14T17:04:17.918ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
30082024-11-14T17:04:17.918ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c
30092024-11-14T17:04:17.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 433162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61506 req_id = 8943185a-d720-47a0-9789-7125a9c01a9a response_code = 200 uri = /inventory
30102024-11-14T17:04:22.397ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30112024-11-14T17:04:22.398ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30122024-11-14T17:04:22.399ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30132024-11-14T17:04:22.399ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30142024-11-14T17:04:22.400ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30152024-11-14T17:04:22.401ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30162024-11-14T17:04:22.402ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30172024-11-14T17:04:22.403ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30182024-11-14T17:04:22.404ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30192024-11-14T17:04:22.404ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30202024-11-14T17:04:22.405ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30212024-11-14T17:04:22.415ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30222024-11-14T17:04:22.416ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30232024-11-14T17:04:22.417ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30242024-11-14T17:04:22.417ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30252024-11-14T17:04:22.418ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30262024-11-14T17:04:22.443ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30272024-11-14T17:04:22.527ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30282024-11-14T17:04:32.401ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30292024-11-14T17:04:32.401ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30302024-11-14T17:04:32.402ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30312024-11-14T17:04:32.403ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30322024-11-14T17:04:32.404ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30332024-11-14T17:04:32.404ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30342024-11-14T17:04:32.405ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30352024-11-14T17:04:32.406ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30362024-11-14T17:04:32.407ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30372024-11-14T17:04:32.407ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30382024-11-14T17:04:32.408ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30392024-11-14T17:04:32.418ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30402024-11-14T17:04:32.419ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30412024-11-14T17:04:32.419ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30422024-11-14T17:04:32.420ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30432024-11-14T17:04:32.420ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30442024-11-14T17:04:32.444ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30452024-11-14T17:04:32.529ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30462024-11-14T17:04:42.403ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30472024-11-14T17:04:42.404ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30482024-11-14T17:04:42.405ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30492024-11-14T17:04:42.405ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30502024-11-14T17:04:42.407ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30512024-11-14T17:04:42.407ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30522024-11-14T17:04:42.408ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30532024-11-14T17:04:42.409ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30542024-11-14T17:04:42.410ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30552024-11-14T17:04:42.410ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30562024-11-14T17:04:42.411ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30572024-11-14T17:04:42.421ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30582024-11-14T17:04:42.421ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30592024-11-14T17:04:42.422ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30602024-11-14T17:04:42.422ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30612024-11-14T17:04:42.423ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30622024-11-14T17:04:42.447ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30632024-11-14T17:04:42.531ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
30642024-11-14T17:04:45.848ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46022
30652024-11-14T17:04:45.849ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46022 req_id = 40d17dbe-59fa-4ff4-bf37-82317351c2f3 response_code = 200 uri = /baseboard
30662024-11-14T17:04:47.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49262
30672024-11-14T17:04:47.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49262 req_id = d4a383d2-3ad9-417b-95bd-babea6a47306 response_code = 200 uri = /vpc-routes
30682024-11-14T17:04:47.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60734
30692024-11-14T17:04:47.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60734 req_id = 42d01c95-7081-437b-a480-554ec29d268a response_code = 200 uri = /v2p
30702024-11-14T17:04:47.064ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
30712024-11-14T17:04:47.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49262 req_id = 7cb752e8-3073-45b9-bad7-b12ea473144b response_code = 204 uri = /eip-gateways
30722024-11-14T17:04:47.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50607
30732024-11-14T17:04:47.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50607 req_id = 180659e6-af2c-4df3-9eee-c991100eecb2 response_code = 200 uri = /vpc-routes
30742024-11-14T17:04:47.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55315
30752024-11-14T17:04:47.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55315 req_id = 328f6afa-c17a-42c3-bf4d-63569acd13b9 response_code = 200 uri = /vpc-routes
30762024-11-14T17:04:47.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49262 req_id = 67c5095d-0641-44bd-8f00-d21e03dafe93 response_code = 204 uri = /vpc-routes
30772024-11-14T17:04:47.088ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
30782024-11-14T17:04:47.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50607 req_id = 62a61ded-4d76-45f4-889e-ba837a184b24 response_code = 204 uri = /eip-gateways
30792024-11-14T17:04:47.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65223
30802024-11-14T17:04:47.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65223 req_id = 48de704b-8d95-4cdd-94b2-e1eb7d7548f2 response_code = 200 uri = /v2p
30812024-11-14T17:04:47.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42061
30822024-11-14T17:04:47.104ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30832024-11-14T17:04:47.149ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30842024-11-14T17:04:47.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105322 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42061 req_id = 3f0078c0-7e47-45b0-8ce2-aab33a1cec8b response_code = 204 uri = /switch-ports
30852024-11-14T17:04:47.210ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
30862024-11-14T17:04:47.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55315 req_id = e96b3085-c3c4-4565-b817-0cc7c6eccd48 response_code = 204 uri = /eip-gateways
30872024-11-14T17:04:47.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63232
30882024-11-14T17:04:47.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50484
30892024-11-14T17:04:47.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53301
30902024-11-14T17:04:47.210ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30912024-11-14T17:04:47.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42061 req_id = e1feeee3-67d3-4e56-bfc1-47c70454bafa response_code = 200 uri = /network-bootstore-config
30922024-11-14T17:04:47.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4682 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50607 req_id = 71869618-40bc-43ba-b246-8799c13e6c1c response_code = 204 uri = /vpc-routes
30932024-11-14T17:04:47.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4427 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50484 req_id = e91df61b-dbf5-49af-8046-bf9f5ab8d419 response_code = 200 uri = /v2p
30942024-11-14T17:04:47.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55315 req_id = 7ab6979a-8fd9-4a1d-982a-797ca49c5553 response_code = 204 uri = /vpc-routes
30952024-11-14T17:04:47.252ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30962024-11-14T17:04:47.310ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30972024-11-14T17:04:47.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100632 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63232 req_id = 1e40d833-7bb0-4510-b1a1-1ba65ea63fa0 response_code = 204 uri = /switch-ports
30982024-11-14T17:04:47.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 744 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63232 req_id = 54df17b9-d891-4d36-a5b6-21dac1366dbf response_code = 200 uri = /network-bootstore-config
30992024-11-14T17:04:47.348ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31002024-11-14T17:04:47.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195439 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53301 req_id = d32703b4-456f-49c3-9ce4-c3c90d3e2373 response_code = 204 uri = /switch-ports
31012024-11-14T17:04:47.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53301 req_id = 44aaa8aa-52b7-4111-a4ee-9b487a31eade response_code = 200 uri = /network-bootstore-config
31022024-11-14T17:04:52.408ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31032024-11-14T17:04:52.408ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31042024-11-14T17:04:52.409ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31052024-11-14T17:04:52.410ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31062024-11-14T17:04:52.411ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31072024-11-14T17:04:52.412ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31082024-11-14T17:04:52.412ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31092024-11-14T17:04:52.413ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31102024-11-14T17:04:52.414ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31112024-11-14T17:04:52.415ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31122024-11-14T17:04:52.415ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31132024-11-14T17:04:52.422ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31142024-11-14T17:04:52.423ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31152024-11-14T17:04:52.424ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31162024-11-14T17:04:52.424ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31172024-11-14T17:04:52.425ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31182024-11-14T17:04:52.449ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31192024-11-14T17:04:52.533ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31202024-11-14T17:05:02.412ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31212024-11-14T17:05:02.412ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31222024-11-14T17:05:02.413ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31232024-11-14T17:05:02.414ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31242024-11-14T17:05:02.415ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31252024-11-14T17:05:02.416ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31262024-11-14T17:05:02.416ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31272024-11-14T17:05:02.417ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31282024-11-14T17:05:02.418ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31292024-11-14T17:05:02.419ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31302024-11-14T17:05:02.419ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31312024-11-14T17:05:02.423ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31322024-11-14T17:05:02.425ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31332024-11-14T17:05:02.426ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31342024-11-14T17:05:02.426ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31352024-11-14T17:05:02.427ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31362024-11-14T17:05:02.452ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31372024-11-14T17:05:02.535ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31382024-11-14T17:05:12.416ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31392024-11-14T17:05:12.416ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31402024-11-14T17:05:12.417ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31412024-11-14T17:05:12.418ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31422024-11-14T17:05:12.419ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31432024-11-14T17:05:12.420ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31442024-11-14T17:05:12.420ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31452024-11-14T17:05:12.421ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31462024-11-14T17:05:12.422ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31472024-11-14T17:05:12.423ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31482024-11-14T17:05:12.423ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31492024-11-14T17:05:12.425ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31502024-11-14T17:05:12.428ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31512024-11-14T17:05:12.428ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31522024-11-14T17:05:12.428ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31532024-11-14T17:05:12.429ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31542024-11-14T17:05:12.456ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31552024-11-14T17:05:12.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31562024-11-14T17:05:15.880ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54407
31572024-11-14T17:05:15.880ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54407 req_id = 51419d3d-df0a-4f36-87d2-eb5aadb75dd2 response_code = 200 uri = /baseboard
31582024-11-14T17:05:16.999ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37945
31592024-11-14T17:05:16.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37945 req_id = 29266f95-d864-4f3b-8e57-1b497bea43eb response_code = 200 uri = /vpc-routes
31602024-11-14T17:05:17.061ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
31612024-11-14T17:05:17.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37945 req_id = 2d28b4f0-7e77-4f31-b664-bd19099a15e8 response_code = 204 uri = /eip-gateways
31622024-11-14T17:05:17.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37945 req_id = bdcf8eb0-21ee-4ba6-9e9f-a5cbd4374ef0 response_code = 204 uri = /vpc-routes
31632024-11-14T17:05:17.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58173
31642024-11-14T17:05:17.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58173 req_id = 2fab5ec3-a3a4-4ac4-a025-a318d2c4faf4 response_code = 200 uri = /v2p
31652024-11-14T17:05:17.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39045
31662024-11-14T17:05:17.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39045 req_id = 435d7e70-4824-4f50-ab1c-496f3da79d8a response_code = 200 uri = /vpc-routes
31672024-11-14T17:05:17.316ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
31682024-11-14T17:05:17.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39045 req_id = 9f8e0a88-3e7d-4f4b-a555-b1d761261258 response_code = 204 uri = /eip-gateways
31692024-11-14T17:05:17.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39045 req_id = d70b630a-8801-4404-89ea-f1407d78deea response_code = 204 uri = /vpc-routes
31702024-11-14T17:05:17.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60335
31712024-11-14T17:05:17.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60335 req_id = 04e6c16c-4e3c-49fa-98dd-39be75e630df response_code = 200 uri = /vpc-routes
31722024-11-14T17:05:17.365ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
31732024-11-14T17:05:17.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60335 req_id = 9c43e9a9-40b8-4295-8925-4ad76e323087 response_code = 204 uri = /eip-gateways
31742024-11-14T17:05:17.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60335 req_id = b20f4094-d9ea-4928-bf2e-eeb22f5169f4 response_code = 204 uri = /vpc-routes
31752024-11-14T17:05:17.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60441
31762024-11-14T17:05:17.386ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31772024-11-14T17:05:17.436ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31782024-11-14T17:05:17.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119769 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60441 req_id = a040ea65-05f7-42f5-a380-e8a5402daeba response_code = 204 uri = /switch-ports
31792024-11-14T17:05:17.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34881
31802024-11-14T17:05:17.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48565
31812024-11-14T17:05:17.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59028
31822024-11-14T17:05:17.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51383
31832024-11-14T17:05:17.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 333 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60441 req_id = cc6300cb-edde-433c-93a5-82d06fb57946 response_code = 200 uri = /network-bootstore-config
31842024-11-14T17:05:17.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51383 req_id = 7d6b3c14-1cdf-40cc-998b-76817dfe07c6 response_code = 200 uri = /v2p
31852024-11-14T17:05:17.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48565 req_id = 8f96ed9c-47fc-4ae3-850e-96d62082c52d response_code = 200 uri = /v2p
31862024-11-14T17:05:17.507ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31872024-11-14T17:05:17.547ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31882024-11-14T17:05:17.607ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31892024-11-14T17:05:17.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100696 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34881 req_id = 202bb514-b4fe-4776-9bda-b7f393496461 response_code = 204 uri = /switch-ports
31902024-11-14T17:05:17.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 784 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34881 req_id = a219222b-a3a3-43b1-8a8f-7180a42c2a17 response_code = 200 uri = /network-bootstore-config
31912024-11-14T17:05:17.644ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31922024-11-14T17:05:17.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196247 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59028 req_id = 6d2e484b-bcff-46b2-9007-164638c4e204 response_code = 204 uri = /switch-ports
31932024-11-14T17:05:17.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59028 req_id = 5191fb84-187b-4fe5-9fc5-984722f7707f response_code = 200 uri = /network-bootstore-config
31942024-11-14T17:05:22.419ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31952024-11-14T17:05:22.419ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31962024-11-14T17:05:22.420ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31972024-11-14T17:05:22.421ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31982024-11-14T17:05:22.422ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
31992024-11-14T17:05:22.423ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32002024-11-14T17:05:22.423ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32012024-11-14T17:05:22.424ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32022024-11-14T17:05:22.425ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32032024-11-14T17:05:22.426ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32042024-11-14T17:05:22.426ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32052024-11-14T17:05:22.426ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32062024-11-14T17:05:22.429ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32072024-11-14T17:05:22.430ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32082024-11-14T17:05:22.430ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32092024-11-14T17:05:22.431ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32102024-11-14T17:05:22.458ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32112024-11-14T17:05:22.539ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32122024-11-14T17:05:32.423ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32132024-11-14T17:05:32.424ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32142024-11-14T17:05:32.425ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32152024-11-14T17:05:32.425ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32162024-11-14T17:05:32.427ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32172024-11-14T17:05:32.427ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32182024-11-14T17:05:32.428ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32192024-11-14T17:05:32.429ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32202024-11-14T17:05:32.430ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32212024-11-14T17:05:32.430ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32222024-11-14T17:05:32.431ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32232024-11-14T17:05:32.431ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32242024-11-14T17:05:32.432ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32252024-11-14T17:05:32.432ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32262024-11-14T17:05:32.433ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32272024-11-14T17:05:32.433ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32282024-11-14T17:05:32.461ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32292024-11-14T17:05:32.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32302024-11-14T17:05:42.428ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32312024-11-14T17:05:42.429ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32322024-11-14T17:05:42.430ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32332024-11-14T17:05:42.430ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32342024-11-14T17:05:42.432ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32352024-11-14T17:05:42.433ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32362024-11-14T17:05:42.433ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32372024-11-14T17:05:42.434ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32382024-11-14T17:05:42.435ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32392024-11-14T17:05:42.436ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32402024-11-14T17:05:42.436ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32412024-11-14T17:05:42.437ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32422024-11-14T17:05:42.438ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32432024-11-14T17:05:42.439ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32442024-11-14T17:05:42.439ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32452024-11-14T17:05:42.440ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32462024-11-14T17:05:42.462ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32472024-11-14T17:05:42.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32482024-11-14T17:05:45.915ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53575
32492024-11-14T17:05:45.915ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53575 req_id = 0add5db4-f64e-4afa-aa26-beb225992f99 response_code = 200 uri = /baseboard
32502024-11-14T17:05:46.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40621
32512024-11-14T17:05:46.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40621 req_id = 358944db-ec4a-4946-b953-eb1b7c6287f5 response_code = 200 uri = /vpc-routes
32522024-11-14T17:05:46.970ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53914
32532024-11-14T17:05:46.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53914 req_id = ffd0dfde-2deb-4810-9116-844d50b323d3 response_code = 200 uri = /v2p
32542024-11-14T17:05:46.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62890
32552024-11-14T17:05:46.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62890 req_id = f43a8022-02e4-41bd-8f00-6dc795d57edd response_code = 200 uri = /vpc-routes
32562024-11-14T17:05:47.019ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
32572024-11-14T17:05:47.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40621 req_id = 55a2deb1-d3ef-4e86-b867-9806b15faa43 response_code = 204 uri = /eip-gateways
32582024-11-14T17:05:47.021ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
32592024-11-14T17:05:47.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62890 req_id = f5d10353-900c-491d-b780-3b74e784d713 response_code = 204 uri = /eip-gateways
32602024-11-14T17:05:47.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40621 req_id = 3e058419-03f0-47bf-952b-b20199000d04 response_code = 204 uri = /vpc-routes
32612024-11-14T17:05:47.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62890 req_id = 0cc44a20-b96f-4f03-974a-566950b101cb response_code = 204 uri = /vpc-routes
32622024-11-14T17:05:47.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55491
32632024-11-14T17:05:47.093ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32642024-11-14T17:05:47.138ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32652024-11-14T17:05:47.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107636 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55491 req_id = 84321bd2-d81b-41cb-96a3-46905df305f5 response_code = 204 uri = /switch-ports
32662024-11-14T17:05:47.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61582
32672024-11-14T17:05:47.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53260
32682024-11-14T17:05:47.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48260
32692024-11-14T17:05:47.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48260 req_id = 21085f5e-a572-48de-ad48-745c3410fda8 response_code = 200 uri = /v2p
32702024-11-14T17:05:47.201ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32712024-11-14T17:05:47.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53260 req_id = f2dbea12-d83c-48fe-aeee-97f8064d7b6a response_code = 200 uri = /vpc-routes
32722024-11-14T17:05:47.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55491 req_id = dd14bb2c-716a-43e2-9d7d-6b3258813974 response_code = 200 uri = /network-bootstore-config
32732024-11-14T17:05:47.241ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49779
32742024-11-14T17:05:47.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 325 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49779 req_id = 1446a4ac-7358-4859-baf4-8e9276511861 response_code = 200 uri = /v2p
32752024-11-14T17:05:47.245ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
32762024-11-14T17:05:47.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53260 req_id = 4080ea3a-17b1-4abd-bdc0-ea949b24260a response_code = 204 uri = /eip-gateways
32772024-11-14T17:05:47.252ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32782024-11-14T17:05:47.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 901 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53260 req_id = 30fb1391-6090-4ff6-a082-e12051ee0928 response_code = 204 uri = /vpc-routes
32792024-11-14T17:05:47.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61058
32802024-11-14T17:05:47.323ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32812024-11-14T17:05:47.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122091 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61582 req_id = bb46ebac-5f69-4107-ac4b-bbdff6fd3157 response_code = 204 uri = /switch-ports
32822024-11-14T17:05:47.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 747 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61582 req_id = cc37786b-66b3-42cc-ac55-cf59af002712 response_code = 200 uri = /network-bootstore-config
32832024-11-14T17:05:47.363ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32842024-11-14T17:05:47.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170064 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61058 req_id = 4e9018ac-e68d-4cda-a3a8-dde9ebe56308 response_code = 204 uri = /switch-ports
32852024-11-14T17:05:47.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61058 req_id = d0e5eeac-f223-4160-9366-2e2e970db71e response_code = 200 uri = /network-bootstore-config
32862024-11-14T17:05:52.433ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32872024-11-14T17:05:52.434ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32882024-11-14T17:05:52.435ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32892024-11-14T17:05:52.436ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32902024-11-14T17:05:52.437ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32912024-11-14T17:05:52.438ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32922024-11-14T17:05:52.439ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32932024-11-14T17:05:52.440ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32942024-11-14T17:05:52.441ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32952024-11-14T17:05:52.442ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32962024-11-14T17:05:52.442ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32972024-11-14T17:05:52.443ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32982024-11-14T17:05:52.443ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
32992024-11-14T17:05:52.444ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33002024-11-14T17:05:52.444ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33012024-11-14T17:05:52.444ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33022024-11-14T17:05:52.464ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33032024-11-14T17:05:52.546ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33042024-11-14T17:06:02.438ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33052024-11-14T17:06:02.439ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33062024-11-14T17:06:02.440ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33072024-11-14T17:06:02.441ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33082024-11-14T17:06:02.442ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33092024-11-14T17:06:02.443ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33102024-11-14T17:06:02.444ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33112024-11-14T17:06:02.445ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33122024-11-14T17:06:02.445ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33132024-11-14T17:06:02.446ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33142024-11-14T17:06:02.447ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33152024-11-14T17:06:02.447ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33162024-11-14T17:06:02.448ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33172024-11-14T17:06:02.448ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33182024-11-14T17:06:02.449ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33192024-11-14T17:06:02.449ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33202024-11-14T17:06:02.467ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33212024-11-14T17:06:02.548ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33222024-11-14T17:06:12.442ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33232024-11-14T17:06:12.443ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33242024-11-14T17:06:12.444ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33252024-11-14T17:06:12.444ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33262024-11-14T17:06:12.446ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33272024-11-14T17:06:12.446ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33282024-11-14T17:06:12.447ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33292024-11-14T17:06:12.448ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33302024-11-14T17:06:12.449ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33312024-11-14T17:06:12.449ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33322024-11-14T17:06:12.450ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33332024-11-14T17:06:12.451ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33342024-11-14T17:06:12.451ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33352024-11-14T17:06:12.452ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33362024-11-14T17:06:12.453ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33372024-11-14T17:06:12.454ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33382024-11-14T17:06:12.469ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33392024-11-14T17:06:12.550ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33402024-11-14T17:06:15.948ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41444
33412024-11-14T17:06:15.948ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41444 req_id = ecc2bb62-1b07-48ee-b040-95eb0693d2f9 response_code = 200 uri = /baseboard
33422024-11-14T17:06:16.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51729
33432024-11-14T17:06:16.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51729 req_id = c4d8b888-8abf-4f52-871c-7e519c2d7e57 response_code = 200 uri = /v2p
33442024-11-14T17:06:16.659ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(5658212) }
33452024-11-14T17:06:16.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 622 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51729 req_id = c4db5c8a-4cd1-481d-adac-9e0047721d93 response_code = 204 uri = /v2p
33462024-11-14T17:06:17.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49818
33472024-11-14T17:06:17.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49818 req_id = 22530946-befb-4bb9-aee5-c40ced131212 response_code = 200 uri = /vpc-routes
33482024-11-14T17:06:17.113ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {f5a3cbc2-404e-43a0-8459-9f0ac080dd26: {10.151.1.176: {812e4d69-c3da-49d6-b5fe-cfa5df819e14}, 10.151.1.175: {812e4d69-c3da-49d6-b5fe-cfa5df819e14}}} }
33492024-11-14T17:06:17.115ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1231 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
33502024-11-14T17:06:17.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2999 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49818 req_id = 0d369d79-6ef3-4e24-9275-a64ccd2c71ab response_code = 204 uri = /eip-gateways
33512024-11-14T17:06:17.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49818 req_id = 66c539f7-4324-4379-af79-806dd4685434 response_code = 204 uri = /vpc-routes
33522024-11-14T17:06:17.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57813
33532024-11-14T17:06:17.202ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: f5a3cbc2-404e-43a0-8459-9f0ac080dd26, kind: Instance { id: f6412a11-ec40-46d5-85bb-1b388201d9dd }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5658212), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f5a3cbc2-404e-43a0-8459-9f0ac080dd26, kind: Instance { id: f6412a11-ec40-46d5-85bb-1b388201d9dd }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5658212), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f5a3cbc2-404e-43a0-8459-9f0ac080dd26, kind: Instance { id: f6412a11-ec40-46d5-85bb-1b388201d9dd }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5658212), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(5658212))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f5a3cbc2-404e-43a0-8459-9f0ac080dd26, kind: Instance { id: f6412a11-ec40-46d5-85bb-1b388201d9dd }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5658212), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-59c099d6411", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: ab77a098-873f-43d0-87b5-6f6d245beb29, read_only_parent: Some(Volume { block_size: 512, id: 9ede3e26-8f64-4c94-a8fd-682c398309a4, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: b71b30f4-4701-4b71-b4a8-d3aaa9dc2355, key: Some("AEPhRIIIl3XKtNhCv+2rOR3UqEIbZDp5MPP3DOx8IjA="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::13]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: ab77a098-873f-43d0-87b5-6f6d245beb29, key: Some("avZabGI/thcsxKtD4Xl9ilRCf8D1obGbHHH4Gph/vfw="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19002", "[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::14]:19001"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-59c099d6411" }] }), cloud_init_bytes: Some(..) } instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd metadata = InstanceMetadata { silo_id: 11404bb1-6f48-4205-9676-954f6fc87352, project_id: 9639fc5c-8366-418e-a328-56348386625c } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-14T17:06:17.190692677Z }
33542024-11-14T17:06:17.202ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd migration_id = None propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f
33552024-11-14T17:06:17.202ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd migration_id = None propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: f5a3cbc2-404e-43a0-8459-9f0ac080dd26, kind: Instance { id: f6412a11-ec40-46d5-85bb-1b388201d9dd }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5658212), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f5a3cbc2-404e-43a0-8459-9f0ac080dd26, kind: Instance { id: f6412a11-ec40-46d5-85bb-1b388201d9dd }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5658212), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f5a3cbc2-404e-43a0-8459-9f0ac080dd26, kind: Instance { id: f6412a11-ec40-46d5-85bb-1b388201d9dd }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5658212), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(5658212))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f5a3cbc2-404e-43a0-8459-9f0ac080dd26, kind: Instance { id: f6412a11-ec40-46d5-85bb-1b388201d9dd }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5658212), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-59c099d6411", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: ab77a098-873f-43d0-87b5-6f6d245beb29, read_only_parent: Some(Volume { block_size: 512, id: 9ede3e26-8f64-4c94-a8fd-682c398309a4, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: b71b30f4-4701-4b71-b4a8-d3aaa9dc2355, key: Some("AEPhRIIIl3XKtNhCv+2rOR3UqEIbZDp5MPP3DOx8IjA="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::13]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: ab77a098-873f-43d0-87b5-6f6d245beb29, key: Some("avZabGI/thcsxKtD4Xl9ilRCf8D1obGbHHH4Gph/vfw="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19002", "[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::14]:19001"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-59c099d6411" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-14T17:06:17.190692677Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
33562024-11-14T17:06:17.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13463 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57813 req_id = e90e95ef-cd80-4f97-adfa-fbcee4716b51 response_code = 200 uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f
33572024-11-14T17:06:17.206ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33478
33582024-11-14T17:06:17.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33478 req_id = 4d155e15-a3ae-4645-b4b5-a01ab87aae07 response_code = 200 uri = /vpc-routes
33592024-11-14T17:06:17.236ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43933
33602024-11-14T17:06:17.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43933 req_id = fe671d8b-e462-47f1-8a0a-6f079997b8e1 response_code = 200 uri = /v2p
33612024-11-14T17:06:17.242ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50518
33622024-11-14T17:06:17.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50518 req_id = 200f4aee-9dfa-4c18-94fb-e575393a193d response_code = 200 uri = /vpc-routes
33632024-11-14T17:06:17.273ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {f5a3cbc2-404e-43a0-8459-9f0ac080dd26: {10.151.1.176: {812e4d69-c3da-49d6-b5fe-cfa5df819e14}, 10.151.1.175: {812e4d69-c3da-49d6-b5fe-cfa5df819e14}}} }
33642024-11-14T17:06:17.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33478 req_id = ba92edd4-2b2f-46ff-b993-916a7cebd4f2 response_code = 204 uri = /eip-gateways
33652024-11-14T17:06:17.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33478 req_id = b1df1270-82e0-49b9-83ba-34fbc334a66a response_code = 204 uri = /vpc-routes
33662024-11-14T17:06:17.298ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {f5a3cbc2-404e-43a0-8459-9f0ac080dd26: {10.151.1.175: {812e4d69-c3da-49d6-b5fe-cfa5df819e14}, 10.151.1.176: {812e4d69-c3da-49d6-b5fe-cfa5df819e14}}} }
33672024-11-14T17:06:17.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50518 req_id = 46cbd80d-df02-4cf2-af05-c4f4e0eec3bf response_code = 204 uri = /eip-gateways
33682024-11-14T17:06:17.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50518 req_id = f30a28ad-09e3-42b9-8600-f757ba4919f4 response_code = 204 uri = /vpc-routes
33692024-11-14T17:06:17.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61217
33702024-11-14T17:06:17.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61217 req_id = abac96c5-7c79-4a12-9a0c-4f3119dbba88 response_code = 200 uri = /v2p
33712024-11-14T17:06:17.337ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61870
33722024-11-14T17:06:17.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61870 req_id = 0c4dbff4-bca2-4659-8a4a-889d33c1e297 response_code = 200 uri = /v2p
33732024-11-14T17:06:17.354ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45492
33742024-11-14T17:06:17.354ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
33752024-11-14T17:06:17.400ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
33762024-11-14T17:06:17.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112852 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45492 req_id = ed2fe997-ed08-45e4-8b4d-93101c7ad611 response_code = 204 uri = /switch-ports
33772024-11-14T17:06:17.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46867
33782024-11-14T17:06:17.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45684
33792024-11-14T17:06:17.467ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
33802024-11-14T17:06:17.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45492 req_id = 8ac94f4e-4dc0-4ff5-a7db-57a10777dfd2 response_code = 200 uri = /network-bootstore-config
33812024-11-14T17:06:17.513ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
33822024-11-14T17:06:17.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54128
33832024-11-14T17:06:17.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1467 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54128 req_id = 1c86498b-bdb9-4767-8d11-b72476c46023 response_code = 200 uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f/state
33842024-11-14T17:06:17.556ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 5658212 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
33852024-11-14T17:06:17.556ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
33862024-11-14T17:06:17.583ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
33872024-11-14T17:06:17.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115868 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45684 req_id = 7e648658-1325-4204-ab77-f20d477d21cb response_code = 204 uri = /switch-ports
33882024-11-14T17:06:17.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5686 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45684 req_id = be2491c3-c0c2-4ab2-a8ed-5e82865c7a63 response_code = 200 uri = /network-bootstore-config
33892024-11-14T17:06:17.607ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f file = illumos-utils/src/zone.rs:325 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f
33902024-11-14T17:06:17.628ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
33912024-11-14T17:06:17.634ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f file = illumos-utils/src/zone.rs:363 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f
33922024-11-14T17:06:17.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233158 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46867 req_id = 0fa106de-b9c3-4f09-bf3c-876f4c8d0f61 response_code = 204 uri = /switch-ports
33932024-11-14T17:06:17.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46867 req_id = 876d26a5-d049-4978-9ff8-024df0df2a83 response_code = 200 uri = /network-bootstore-config
33942024-11-14T17:06:17.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57261
33952024-11-14T17:06:17.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57261 req_id = a6c03d68-69b1-4c3e-9c39-d0b6ccf308c5 response_code = 200 uri = /vpc-routes
33962024-11-14T17:06:17.865ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {f5a3cbc2-404e-43a0-8459-9f0ac080dd26: {10.151.1.175: {812e4d69-c3da-49d6-b5fe-cfa5df819e14}, 10.151.1.176: {812e4d69-c3da-49d6-b5fe-cfa5df819e14}}} }
33972024-11-14T17:06:17.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57261 req_id = 7bafbaf0-3f71-4d93-8eea-6de27a588d22 response_code = 204 uri = /eip-gateways
33982024-11-14T17:06:17.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 455 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57261 req_id = 1bef34d0-7931-473d-bf14-1c7e94febf8a response_code = 204 uri = /vpc-routes
33992024-11-14T17:06:19.181ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f
34002024-11-14T17:06:19.181ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f zone file = illumos-utils/src/running_zone.rs:488 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f zone = oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f
34012024-11-14T17:06:19.370ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f") failed: Property not found. retry in 39.72695ms file = illumos-utils/src/svc.rs:36 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f zone = oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f
34022024-11-14T17:06:19.421ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f") failed: Property not found. retry in 145.690109ms file = illumos-utils/src/svc.rs:36 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f zone = oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f
34032024-11-14T17:06:19.592ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f") failed: Property not found. retry in 207.045324ms file = illumos-utils/src/svc.rs:36 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f zone = oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f
34042024-11-14T17:06:19.818ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f") failed: Property not found. retry in 260.854578ms file = illumos-utils/src/svc.rs:36 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f zone = oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f
34052024-11-14T17:06:20.099ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f") failed: Property not found. retry in 698.638873ms file = illumos-utils/src/svc.rs:36 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f zone = oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f
34062024-11-14T17:06:20.811ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f") failed: Property not found. retry in 918.244321ms file = illumos-utils/src/svc.rs:36 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f zone = oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f
34072024-11-14T17:06:21.743ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f") failed: Property not found. retry in 691.186231ms file = illumos-utils/src/svc.rs:36 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f zone = oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f
34082024-11-14T17:06:22.446ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f") failed: Property not found. retry in 523.315571ms file = illumos-utils/src/svc.rs:36 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f zone = oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f
34092024-11-14T17:06:22.448ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34102024-11-14T17:06:22.449ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34112024-11-14T17:06:22.449ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34122024-11-14T17:06:22.450ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34132024-11-14T17:06:22.451ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34142024-11-14T17:06:22.452ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34152024-11-14T17:06:22.453ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34162024-11-14T17:06:22.454ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34172024-11-14T17:06:22.455ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34182024-11-14T17:06:22.455ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34192024-11-14T17:06:22.456ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34202024-11-14T17:06:22.456ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34212024-11-14T17:06:22.457ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34222024-11-14T17:06:22.457ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34232024-11-14T17:06:22.458ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34242024-11-14T17:06:22.458ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34252024-11-14T17:06:22.471ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34262024-11-14T17:06:22.552ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34272024-11-14T17:06:22.981ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f") failed: Property not found. retry in 833.577375ms file = illumos-utils/src/svc.rs:36 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f zone = oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f
34282024-11-14T17:06:23.830ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f") failed: Property not found. retry in 1.101959547s file = illumos-utils/src/svc.rs:36 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f zone = oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f
34292024-11-14T17:06:24.964ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f file = sled-agent/src/instance.rs:1787 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f
34302024-11-14T17:06:24.973ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f
34312024-11-14T17:06:25.011ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f
34322024-11-14T17:06:25.149ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f
34332024-11-14T17:06:25.150ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-14T17:06:25.150234417Z } file = sled-agent/src/instance.rs:780 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f
34342024-11-14T17:06:25.150ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-14T17:06:25.150234417Z } propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f
34352024-11-14T17:06:25.150ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-14T17:06:25.150234417Z }, migration_in: None, migration_out: None }
34362024-11-14T17:06:25.192ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-14T17:06:25.192620493Z } file = sled-agent/src/instance.rs:780 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f
34372024-11-14T17:06:25.192ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-14T17:06:25.192620493Z } propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f
34382024-11-14T17:06:25.192ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-14T17:06:25.192620493Z }, migration_in: None, migration_out: None }
34392024-11-14T17:06:32.451ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34402024-11-14T17:06:32.452ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34412024-11-14T17:06:32.452ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34422024-11-14T17:06:32.453ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34432024-11-14T17:06:32.454ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34442024-11-14T17:06:32.455ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34452024-11-14T17:06:32.456ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34462024-11-14T17:06:32.457ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34472024-11-14T17:06:32.457ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34482024-11-14T17:06:32.458ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34492024-11-14T17:06:32.459ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34502024-11-14T17:06:32.459ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34512024-11-14T17:06:32.460ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34522024-11-14T17:06:32.460ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34532024-11-14T17:06:32.461ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34542024-11-14T17:06:32.461ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34552024-11-14T17:06:32.473ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34562024-11-14T17:06:32.555ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34572024-11-14T17:06:35.334ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59865
34582024-11-14T17:06:35.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 504 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59865 req_id = 8fdb0daf-0d7c-46ac-af68-650ccbeb9561 response_code = 200 uri = /vmms/29b656d1-a360-4276-b560-d0f74cefd58f/state
34592024-11-14T17:06:35.334ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-14T17:06:35.334848678Z } file = sled-agent/src/instance.rs:780 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f
34602024-11-14T17:06:35.334ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-14T17:06:35.334848678Z } propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f
34612024-11-14T17:06:35.334ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-14T17:06:35.334848678Z }, migration_in: None, migration_out: None }
34622024-11-14T17:06:35.369ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-14T17:06:35.369036929Z } file = sled-agent/src/instance.rs:780 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f
34632024-11-14T17:06:35.369ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-14T17:06:35.369036929Z } propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f
34642024-11-14T17:06:35.369ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f
34652024-11-14T17:06:35.369ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
34662024-11-14T17:06:35.369ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 7478790971625416201 n_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34672024-11-14T17:06:35.369ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 367545700164641320 n_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34682024-11-14T17:06:35.369ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
34692024-11-14T17:06:35.369ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/0f4f4da0-c98a-4c67-b269-a009de7cb287/debug/bundle/zone", "/pool/int/dece35c4-89fd-420c-8f29-55cf8d3ec653/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/da94b0fc-e114-4d62-8eee-1f3b839145a7/crypt/debug", "/pool/ext/0e37ddab-daec-4c38-a903-78b351e48433/crypt/debug", "/pool/ext/a47fbfc2-afec-46c8-bc5a-f6c02b232d2e/crypt/debug", "/pool/ext/e573afbb-ee4c-4f2d-9d08-b65b7fca29cf/crypt/debug", "/pool/ext/63c85555-7e85-4f53-92b1-afc3cd212893/crypt/debug", "/pool/ext/8fbbea6c-76df-4af7-a25f-3e2c165ad855/crypt/debug", "/pool/ext/ad871e3f-9a86-4a01-ac75-964bae58e4aa/crypt/debug", "/pool/ext/f3390b76-1a47-437d-b003-6296b24d9932/crypt/debug", "/pool/ext/ba5bcc53-8777-4a9a-9914-1f9b1ed99d6c/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f
34702024-11-14T17:06:36.046ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f", bundle_id: 24323db9-f604-43c7-bfb1-e28e27868d42 }, time_created: 2024-11-14T17:06:35.370170115Z, version: 0, cause: TerminatedInstance }
34712024-11-14T17:06:36.047ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_29b656d1-a360-4276-b560-d0f74cefd58f file = sled-agent/src/instance.rs:1032 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f
34722024-11-14T17:06:37.817ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f
34732024-11-14T17:06:37.837ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(5658212), kind: System }
34742024-11-14T17:06:37.837ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(5658212), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
34752024-11-14T17:06:37.837ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-14T17:06:37.837529143Z }, migration_in: None, migration_out: None }
34762024-11-14T17:06:37.869ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-14T17:06:37.837529143Z }, migration_in: None, migration_out: None }
34772024-11-14T17:06:37.872ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = f6412a11-ec40-46d5-85bb-1b388201d9dd propolis_id = 29b656d1-a360-4276-b560-d0f74cefd58f
34782024-11-14T17:06:38.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52363
34792024-11-14T17:06:38.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52363 req_id = d7d8cc03-55b0-434a-a340-de16ceb44b6f response_code = 200 uri = /vpc-routes
34802024-11-14T17:06:38.408ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
34812024-11-14T17:06:38.408ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1231 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34822024-11-14T17:06:38.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52363 req_id = bf3cb41e-b0fc-4ae6-a865-d7c268cf6c3b response_code = 204 uri = /eip-gateways
34832024-11-14T17:06:38.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52363 req_id = c009ff78-1e21-4a79-b5b2-a864add1ab52 response_code = 204 uri = /vpc-routes
34842024-11-14T17:06:38.478ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52126
34852024-11-14T17:06:38.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52126 req_id = 80eb21dd-8a34-4084-9e1e-7f5fff9b0ce1 response_code = 200 uri = /v2p
34862024-11-14T17:06:38.628ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45846
34872024-11-14T17:06:38.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45846 req_id = ea033af7-cf92-4bbf-97b0-5c9dc9aff6fa response_code = 200 uri = /v2p
34882024-11-14T17:06:38.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42065
34892024-11-14T17:06:38.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42065 req_id = bdef74d5-8c0f-4f3d-9063-7d6c5ba08475 response_code = 200 uri = /vpc-routes
34902024-11-14T17:06:38.763ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
34912024-11-14T17:06:38.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42065 req_id = 03e6ba56-84ca-408c-8648-c8dc742c8e02 response_code = 204 uri = /eip-gateways
34922024-11-14T17:06:38.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42065 req_id = e0af6e49-0e05-4ff9-8142-d54b79e54550 response_code = 204 uri = /vpc-routes
34932024-11-14T17:06:39.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42448
34942024-11-14T17:06:39.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42448 req_id = 6d717f44-bf77-413f-b369-0c6f41c86f3d response_code = 200 uri = /vpc-routes
34952024-11-14T17:06:39.362ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43 values = ExternalIpGatewayMap { mappings: {} }
34962024-11-14T17:06:39.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42448 req_id = 1be4d838-e377-4a09-8eb5-964f8f17f814 response_code = 204 uri = /eip-gateways
34972024-11-14T17:06:39.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42448 req_id = 5fb076e0-e1a1-4662-b5bb-be1f42b7837f response_code = 204 uri = /vpc-routes
34982024-11-14T17:06:42.455ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
34992024-11-14T17:06:42.456ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
35002024-11-14T17:06:42.456ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
35012024-11-14T17:06:42.457ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
35022024-11-14T17:06:42.458ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
35032024-11-14T17:06:42.459ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
35042024-11-14T17:06:42.460ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
35052024-11-14T17:06:42.461ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
35062024-11-14T17:06:42.461ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
35072024-11-14T17:06:42.462ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
35082024-11-14T17:06:42.463ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
35092024-11-14T17:06:42.463ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
35102024-11-14T17:06:42.464ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
35112024-11-14T17:06:42.464ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
35122024-11-14T17:06:42.465ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
35132024-11-14T17:06:42.465ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43
35142024-11-14T17:06:42.475ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f70fbf74-7489-439f-8ec3-e6e8473a8b43