Max level shown:
1 [ Nov 16 00:44:35 Enabled. ]
2 [ Nov 16 00:44:35 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 16 00:44:35 Method "start" exited with status 0. ]
4 [ Nov 16 00:44:35 Rereading configuration. ]
5 [ Nov 16 00:44:35 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-16T00:44:35.669ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-16T00:44:35.669ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-16T00:44:35.721ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-16T00:44:35.721ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-16T00:44:35.834ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-16T00:44:35.843ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-16T00:44:35.851ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-16T00:44:36.453ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-11-16T00:44:36.588ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-16T00:44:36.588ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-16T00:44:36.588ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-16T00:44:36.588ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-16T00:44:36.588ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-11-16T00:44:36.588ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-11-16T00:44:36.591ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-16T00:44:36.591ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-16T00:44:36.591ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-16T00:44:36.591ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-16T00:44:36.591ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-16T00:44:36.591ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-16T00:44:36.591ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-11-16T00:44:36.591ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-16T00:44:36.591ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-16T00:44:36.601ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-16T00:44:36.601ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 663efa11-5b34-43d6-b3ef-035ad0cb3d52 (zpool)
322024-11-16T00:44:36.698ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 663efa11-5b34-43d6-b3ef-035ad0cb3d52 (zpool), kind: Internal }
332024-11-16T00:44:37.175ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-11-16T00:44:37.175ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-16T00:44:37.175ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-16T00:44:37.175ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-16T00:44:37.175ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-11-16T00:44:37.175ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-16T00:44:37.175ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-16T00:44:37.184ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-16T00:44:37.184ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = cf590775-1e7e-4c57-848f-c6dd49cdc702 (zpool)
422024-11-16T00:44:37.274ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: cf590775-1e7e-4c57-848f-c6dd49cdc702 (zpool), kind: Internal }
432024-11-16T00:44:37.751ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-16T00:44:37.751ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 663efa11-5b34-43d6-b3ef-035ad0cb3d52 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cf590775-1e7e-4c57-848f-c6dd49cdc702 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-16T00:44:37.751ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-11-16T00:44:37.751ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-11-16T00:44:37.751ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
482024-11-16T00:44:37.751ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-11-16T00:44:37.751ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-16T00:44:37.751ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 663efa11-5b34-43d6-b3ef-035ad0cb3d52 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cf590775-1e7e-4c57-848f-c6dd49cdc702 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-11-16T00:44:37.751ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-11-16T00:44:37.751ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532024-11-16T00:44:37.751ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
542024-11-16T00:44:37.751ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-11-16T00:44:37.751ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-16T00:44:37.751ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 663efa11-5b34-43d6-b3ef-035ad0cb3d52 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cf590775-1e7e-4c57-848f-c6dd49cdc702 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-11-16T00:44:37.751ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
582024-11-16T00:44:37.751ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
592024-11-16T00:44:37.751ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
602024-11-16T00:44:37.751ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-11-16T00:44:37.751ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-16T00:44:37.751ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
632024-11-16T00:44:37.751ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 663efa11-5b34-43d6-b3ef-035ad0cb3d52 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cf590775-1e7e-4c57-848f-c6dd49cdc702 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
642024-11-16T00:44:37.751ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652024-11-16T00:44:37.751ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-11-16T00:44:37.751ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-11-16T00:44:37.751ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-16T00:44:37.751ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 663efa11-5b34-43d6-b3ef-035ad0cb3d52 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cf590775-1e7e-4c57-848f-c6dd49cdc702 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-11-16T00:44:37.751ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-11-16T00:44:37.751ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-11-16T00:44:37.751ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
722024-11-16T00:44:37.751ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-11-16T00:44:37.751ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-16T00:44:37.751ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 663efa11-5b34-43d6-b3ef-035ad0cb3d52 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cf590775-1e7e-4c57-848f-c6dd49cdc702 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-11-16T00:44:37.751ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-11-16T00:44:37.751ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-11-16T00:44:37.751ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-11-16T00:44:37.751ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-11-16T00:44:37.751ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-11-16T00:44:37.751ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
812024-11-16T00:44:37.751ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822024-11-16T00:44:37.751ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 663efa11-5b34-43d6-b3ef-035ad0cb3d52 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cf590775-1e7e-4c57-848f-c6dd49cdc702 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832024-11-16T00:44:37.751ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842024-11-16T00:44:37.751ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852024-11-16T00:44:37.751ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-11-16T00:44:37.751ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
872024-11-16T00:44:37.751ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-11-16T00:44:37.751ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 663efa11-5b34-43d6-b3ef-035ad0cb3d52 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cf590775-1e7e-4c57-848f-c6dd49cdc702 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892024-11-16T00:44:37.752ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
902024-11-16T00:44:37.752ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
912024-11-16T00:44:37.752ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
922024-11-16T00:44:37.752ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
932024-11-16T00:44:37.752ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-11-16T00:44:37.752ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 663efa11-5b34-43d6-b3ef-035ad0cb3d52 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cf590775-1e7e-4c57-848f-c6dd49cdc702 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-11-16T00:44:37.752ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-11-16T00:44:37.752ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-11-16T00:44:37.752ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-11-16T00:44:37.752ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-11-16T00:44:37.752ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 663efa11-5b34-43d6-b3ef-035ad0cb3d52 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cf590775-1e7e-4c57-848f-c6dd49cdc702 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-11-16T00:44:37.752ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1012024-11-16T00:44:37.752ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022024-11-16T00:44:37.752ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032024-11-16T00:44:37.752ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-11-16T00:44:37.752ZINFOSledAgent (bootstore): No ledger in /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-11-16T00:44:37.752ZINFOSledAgent (bootstore): No ledger in /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-11-16T00:44:37.752ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-11-16T00:44:37.752ZINFOSledAgent (bootstore): No ledger in /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-11-16T00:44:37.752ZINFOSledAgent (bootstore): No ledger in /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-11-16T00:44:37.752ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-11-16T00:44:37.752ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-16T00:44:37.752ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-16T00:44:37.763ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1132024-11-16T00:44:37.763ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1370, tv_nsec: 577213143 } time_to_next_cleanup = 599.999947609s
1142024-11-16T00:44:37.763ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1152024-11-16T00:44:37.763ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-11-16T00:44:37.763ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-11-16T00:44:37.763ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-11-16T00:44:37.766ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-11-16T00:44:37.768ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-11-16T00:44:37.768ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1200
1212024-11-16T00:44:37.768ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-16T00:44:37.769ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-11-16T00:44:37.769ZINFOSledAgent (RSS): No ledger in /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-11-16T00:44:37.769ZINFOSledAgent (RSS): No ledger in /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-11-16T00:44:37.769ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1263
1262024-11-16T00:44:37.769ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1272024-11-16T00:44:37.769ZINFOSledAgent (RSS): No ledger in /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-11-16T00:44:37.769ZINFOSledAgent (RSS): No ledger in /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-11-16T00:44:37.769ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1305
1302024-11-16T00:44:37.769ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-16T00:44:37.769ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-16T00:44:37.769ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1332024-11-16T00:44:37.769ZINFOSledAgent (RSS): Writing ledger to /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-11-16T00:44:37.769ZINFOSledAgent (RSS): Writing ledger to /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-11-16T00:44:37.769ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: b933f208-5503-4ef4-a58c-ba230a4cccac, sleds: { [fdb0:18c0:4d0d:a02a::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: ad7c66bd-0d53-43e9-89e8-86e0651ea05d (sled), rack_id: b933f208-5503-4ef4-a58c-ba230a4cccac, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-11-16T00:44:37.769ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1339
1372024-11-16T00:44:37.769ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1382024-11-16T00:44:37.769ZINFOSledAgent (bootstore): Writing ledger to /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1392024-11-16T00:44:37.769ZINFOSledAgent (bootstore): Writing ledger to /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1402024-11-16T00:44:37.770ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1412024-11-16T00:44:37.770ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: ad7c66bd-0d53-43e9-89e8-86e0651ea05d (sled), rack_id: b933f208-5503-4ef4-a58c-ba230a4cccac, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1422024-11-16T00:44:37.770ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1432024-11-16T00:44:37.770ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1442024-11-16T00:44:37.775ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1452024-11-16T00:44:37.781ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-11-16T00:44:37.781ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-11-16T00:44:37.785ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1482024-11-16T00:44:37.785ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1492024-11-16T00:44:37.785ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:52133
1502024-11-16T00:44:37.785ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: ad7c66bd-0d53-43e9-89e8-86e0651ea05d (sled), rack_id: b933f208-5503-4ef4-a58c-ba230a4cccac, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1512024-11-16T00:44:37.785ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1522024-11-16T00:44:37.785ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532024-11-16T00:44:37.785ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542024-11-16T00:44:37.785ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552024-11-16T00:44:37.785ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1562024-11-16T00:44:37.785ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1572024-11-16T00:44:37.786ZINFOSledAgent (StorageManager): No ledger in /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1582024-11-16T00:44:37.786ZINFOSledAgent (StorageManager): No ledger in /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1592024-11-16T00:44:37.786ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1602024-11-16T00:44:37.786ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1612024-11-16T00:44:37.786ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1622024-11-16T00:44:37.786ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1632024-11-16T00:44:37.786ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1642024-11-16T00:44:37.803ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1652024-11-16T00:44:37.824ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1662024-11-16T00:44:37.840ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1672024-11-16T00:44:37.848ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:408 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
1682024-11-16T00:44:37.848ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1692024-11-16T00:44:37.848ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:420 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
1702024-11-16T00:44:37.848ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1712024-11-16T00:44:37.851ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 109.033315ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8c13d0a7-d40e-424a-ac3e-64837658a25a", "content-length": "124", "date": "Sat, 16 Nov 2024 00:44:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8c13d0a7-d40e-424a-ac3e-64837658a25a" } file = clients/ddm-admin-client/src/lib.rs:177
1722024-11-16T00:44:37.861ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_663efa11-5b34-43d6-b3ef-035ad0cb3d52/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1732024-11-16T00:44:37.883ZINFOSledAgent: successfully created encrypted zvol: name="oxi_663efa11-5b34-43d6-b3ef-035ad0cb3d52/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1742024-11-16T00:44:37.883ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_663efa11-5b34-43d6-b3ef-035ad0cb3d52/swap" file = sled-agent/src/swap_device.rs:96
1752024-11-16T00:44:37.888ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:435 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
1762024-11-16T00:44:37.888ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1772024-11-16T00:44:37.888ZINFOSledAgent (BackingFs): Ensuring dataset oxi_663efa11-5b34-43d6-b3ef-035ad0cb3d52/backing/fmd file = sled-agent/src/backing_fs.rs:138
1782024-11-16T00:44:37.962ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1792024-11-16T00:44:37.962ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 149.435176ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8a82bc69-2ebd-4660-87c7-14b081a4aa55", "content-length": "124", "date": "Sat, 16 Nov 2024 00:44:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8a82bc69-2ebd-4660-87c7-14b081a4aa55" } file = clients/ddm-admin-client/src/lib.rs:177
1802024-11-16T00:44:37.974ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1812024-11-16T00:44:38.112ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-11-16T00:44:38.113ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 116.409613ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5e7c2475-4d76-485e-809b-b1ba8a58c6f9", "content-length": "124", "date": "Sat, 16 Nov 2024 00:44:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5e7c2475-4d76-485e-809b-b1ba8a58c6f9" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-11-16T00:44:38.191ZINFOSledAgent (BackingFs): Mounting oxi_663efa11-5b34-43d6-b3ef-035ad0cb3d52/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1842024-11-16T00:44:38.207ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1852024-11-16T00:44:38.207ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1862024-11-16T00:44:38.207ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1872024-11-16T00:44:38.207ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1882024-11-16T00:44:38.230ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-11-16T00:44:38.231ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 252.815832ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "09380620-c84d-49d2-a08b-c2e49a908ecd", "content-length": "124", "date": "Sat, 16 Nov 2024 00:44:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "09380620-c84d-49d2-a08b-c2e49a908ecd" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-11-16T00:44:38.484ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-11-16T00:44:38.485ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 126.276316ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8eaadf8d-e873-4421-bc54-63fad9c80b1d", "content-length": "124", "date": "Sat, 16 Nov 2024 00:44:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8eaadf8d-e873-4421-bc54-63fad9c80b1d" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-11-16T00:44:38.612ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-11-16T00:44:38.613ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 148.161056ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "27824ff2-7cbe-40c1-96c5-b7f3761f58c7", "content-length": "124", "date": "Sat, 16 Nov 2024 00:44:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "27824ff2-7cbe-40c1-96c5-b7f3761f58c7" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-11-16T00:44:38.763ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1952024-11-16T00:44:38.763ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 319.235882ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "839a9552-2021-4f37-9d86-085d06bdab40", "content-length": "124", "date": "Sat, 16 Nov 2024 00:44:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "839a9552-2021-4f37-9d86-085d06bdab40" } file = clients/ddm-admin-client/src/lib.rs:177
1962024-11-16T00:44:38.931ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
1972024-11-16T00:44:38.936ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:51383 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
1982024-11-16T00:44:38.936ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
1992024-11-16T00:44:38.937ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:51383 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
2002024-11-16T00:44:38.938ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 357.40578ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
2012024-11-16T00:44:38.939ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
2022024-11-16T00:44:38.939ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
2032024-11-16T00:44:38.939ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2042024-11-16T00:44:38.939ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2052024-11-16T00:44:39.084ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2062024-11-16T00:44:39.297ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 686.346798ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
2072024-11-16T00:44:39.985ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.293302267s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
2082024-11-16T00:44:41.280ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.243089022s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
2092024-11-16T00:44:41.571ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2102024-11-16T00:44:41.571ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2112024-11-16T00:44:41.571ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2122024-11-16T00:44:41.571ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2132024-11-16T00:44:41.571ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2142024-11-16T00:44:41.571ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2152024-11-16T00:44:41.573ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2162024-11-16T00:44:41.575ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2172024-11-16T00:44:41.575ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='75da1e95-9ecb-4b32-9796-d315ac9ce9f7'/> <propval type="astring" name="rack_id" value='b933f208-5503-4ef4-a58c-ba230a4cccac'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fed9:5b2e'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='b933f208-5503-4ef4-a58c-ba230a4cccac'/> <propval type="astring" name="sled_id" value='ad7c66bd-0d53-43e9-89e8-86e0651ea05d'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='ad7c66bd-0d53-43e9-89e8-86e0651ea05d'/> <propval type="astring" name="rack_uuid" value='b933f208-5503-4ef4-a58c-ba230a4cccac'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='ad7c66bd-0d53-43e9-89e8-86e0651ea05d'/> <propval type="astring" name="rack_uuid" value='b933f208-5503-4ef4-a58c-ba230a4cccac'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2182024-11-16T00:44:41.575ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2192024-11-16T00:44:41.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 72.193866ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-11-16T00:44:42.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 141.338076ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-11-16T00:44:42.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 238.158289ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-11-16T00:44:42.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 399.353977ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-11-16T00:44:43.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 789.560348ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-11-16T00:44:43.526ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.893824865s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
2252024-11-16T00:44:43.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 626.288936ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-16T00:44:44.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 842.752411ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-11-16T00:44:45.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 721.8195ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282024-11-16T00:44:46.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.376619257s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-11-16T00:44:47.422ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 9.665302521s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
2302024-11-16T00:44:48.040ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/ad7c66bd-0d53-43e9-89e8-86e0651ea05d) file = sled-agent/src/nexus.rs:527 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
2312024-11-16T00:44:48.078ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2322024-11-16T00:44:48.078ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
2332024-11-16T00:44:48.079ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2342024-11-16T00:44:48.079ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2352024-11-16T00:44:48.079ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2362024-11-16T00:44:48.079ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2372024-11-16T00:44:48.079ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2382024-11-16T00:44:48.080ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2392024-11-16T00:44:48.080ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2402024-11-16T00:44:48.080ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2412024-11-16T00:44:48.080ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:52133
2422024-11-16T00:44:48.297ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2432024-11-16T00:44:48.297ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2442024-11-16T00:44:48.297ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2452024-11-16T00:44:48.297ZINFOSledAgent (RSS): No ledger in /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2462024-11-16T00:44:48.297ZINFOSledAgent (RSS): No ledger in /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2472024-11-16T00:44:48.297ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2482024-11-16T00:44:48.297ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2492024-11-16T00:44:48.297ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2502024-11-16T00:44:48.297ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2512024-11-16T00:44:48.302ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2522024-11-16T00:44:48.302ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2532024-11-16T00:44:48.302ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2542024-11-16T00:44:48.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57481
2552024-11-16T00:44:48.561ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2562024-11-16T00:44:48.561ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2572024-11-16T00:44:48.561ZINFOSledAgent (ServiceManager): No ledger in /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/omicron-zones.json file = common/src/ledger.rs:188
2582024-11-16T00:44:48.561ZINFOSledAgent (ServiceManager): No ledger in /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/omicron-zones.json file = common/src/ledger.rs:188
2592024-11-16T00:44:48.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 481 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57481 req_id = 97ff2315-fccc-4068-a6f1-a73ae17e67e5 response_code = 200 uri = /inventory
2602024-11-16T00:44:48.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48632
2612024-11-16T00:44:48.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48632 req_id = 6724a065-f53d-4d1e-8435-a5a187518e09 response_code = 200 uri = /sled-role
2622024-11-16T00:44:48.592ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2632024-11-16T00:44:48.592ZINFOSledAgent (RSS): Writing ledger to /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2642024-11-16T00:44:48.592ZINFOSledAgent (RSS): Writing ledger to /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2652024-11-16T00:44:48.593ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:980
2662024-11-16T00:44:48.622ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: b2c456e5-ca39-45b3-9252-18131ce21deb, pool_id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 88d7e0a7-a303-4cb9-b2b0-67535ba30a43, pool_id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: fc6dddcb-9520-4cb4-b3b0-556ee19691d4, pool_id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: a1932173-68fc-44ff-8ffa-4c76dead6804, pool_id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 70f71906-6bc4-47c6-9965-0610a87e1652, pool_id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 057192aa-a830-4e73-b6b6-2b8ad38323b3, pool_id: 2df48cc0-997e-4c6b-92f6-f05e369b8ceb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 264e539e-998a-4c32-b7b8-7e94128c4f9b, pool_id: 769d1181-4cb2-4e0f-87be-d1b20a8a9c58 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 5d8980bc-54ad-4745-967c-afbdb829ad19, pool_id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 25c5eeb1-b52a-4ce3-8f5b-e5a14c5e7955, pool_id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:382 sled_address = [fd00:1122:3344:101::1]:12345
2672024-11-16T00:44:48.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37039
2682024-11-16T00:44:48.622ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:884 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
2692024-11-16T00:44:48.622ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: b2c456e5-ca39-45b3-9252-18131ce21deb, pool_id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 88d7e0a7-a303-4cb9-b2b0-67535ba30a43, pool_id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: fc6dddcb-9520-4cb4-b3b0-556ee19691d4, pool_id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: a1932173-68fc-44ff-8ffa-4c76dead6804, pool_id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 70f71906-6bc4-47c6-9965-0610a87e1652, pool_id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 057192aa-a830-4e73-b6b6-2b8ad38323b3, pool_id: 2df48cc0-997e-4c6b-92f6-f05e369b8ceb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 264e539e-998a-4c32-b7b8-7e94128c4f9b, pool_id: 769d1181-4cb2-4e0f-87be-d1b20a8a9c58 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 5d8980bc-54ad-4745-967c-afbdb829ad19, pool_id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 25c5eeb1-b52a-4ce3-8f5b-e5a14c5e7955, pool_id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2702024-11-16T00:44:48.622ZINFOSledAgent (StorageManager): No ledger in /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2712024-11-16T00:44:48.622ZINFOSledAgent (StorageManager): No ledger in /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2722024-11-16T00:44:48.622ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2732024-11-16T00:44:48.622ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2742024-11-16T00:44:48.622ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2752024-11-16T00:44:48.622ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2762024-11-16T00:44:48.622ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2772024-11-16T00:44:48.770ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2782024-11-16T00:44:48.770ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool)
2792024-11-16T00:44:49.003ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4760110679328225252 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
2802024-11-16T00:44:49.003ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15204801460447072895 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
2812024-11-16T00:44:49.235ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
2822024-11-16T00:44:49.237ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ad7c66bd-0d53-43e9-89e8-86e0651ea05d) file = sled-agent/src/probe_manager.rs:231 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
2832024-11-16T00:44:49.292ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }
2842024-11-16T00:44:49.298ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2852024-11-16T00:44:49.298ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2862024-11-16T00:44:49.298ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2872024-11-16T00:44:49.298ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2882024-11-16T00:44:49.298ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2892024-11-16T00:44:49.298ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2902024-11-16T00:44:49.298ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2912024-11-16T00:44:49.331ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2922024-11-16T00:44:49.340ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crypt/zone file = sled-storage/src/dataset.rs:303
2932024-11-16T00:44:49.511ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8dfb8147-eb55-4ee1-89a5-25b2d27c68ee file = sled-storage/src/dataset.rs:389
2942024-11-16T00:44:49.519ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2952024-11-16T00:44:49.519ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2962024-11-16T00:44:49.519ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2972024-11-16T00:44:49.519ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2982024-11-16T00:44:49.519ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2992024-11-16T00:44:49.530ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
3002024-11-16T00:44:49.530ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d49e8c8c-eb53-43b6-a176-aee4725796df (zpool)
3012024-11-16T00:44:49.623ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }
3022024-11-16T00:44:49.630ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
3032024-11-16T00:44:49.630ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
3042024-11-16T00:44:49.630ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
3052024-11-16T00:44:49.630ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
3062024-11-16T00:44:49.630ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3072024-11-16T00:44:49.631ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3082024-11-16T00:44:49.631ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3092024-11-16T00:44:49.667ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3102024-11-16T00:44:49.675ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d49e8c8c-eb53-43b6-a176-aee4725796df/crypt/zone file = sled-storage/src/dataset.rs:303
3112024-11-16T00:44:49.846ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d49e8c8c-eb53-43b6-a176-aee4725796df file = sled-storage/src/dataset.rs:389
3122024-11-16T00:44:49.854ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3132024-11-16T00:44:49.854ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3142024-11-16T00:44:49.854ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3152024-11-16T00:44:49.854ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3162024-11-16T00:44:49.854ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3172024-11-16T00:44:49.864ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3182024-11-16T00:44:49.864ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool)
3192024-11-16T00:44:49.954ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }
3202024-11-16T00:44:49.962ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3212024-11-16T00:44:49.962ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3222024-11-16T00:44:49.962ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3232024-11-16T00:44:49.962ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3242024-11-16T00:44:49.962ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3252024-11-16T00:44:49.962ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3262024-11-16T00:44:49.962ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3272024-11-16T00:44:49.998ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3282024-11-16T00:44:50.006ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_220cf814-be1b-400b-bb43-5ab45b7eb044/crypt/zone file = sled-storage/src/dataset.rs:303
3292024-11-16T00:44:50.179ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_220cf814-be1b-400b-bb43-5ab45b7eb044 file = sled-storage/src/dataset.rs:389
3302024-11-16T00:44:50.187ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3312024-11-16T00:44:50.187ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3322024-11-16T00:44:50.187ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3332024-11-16T00:44:50.187ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3342024-11-16T00:44:50.187ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3352024-11-16T00:44:50.197ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3362024-11-16T00:44:50.197ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool)
3372024-11-16T00:44:50.292ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }
3382024-11-16T00:44:50.300ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3392024-11-16T00:44:50.300ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3402024-11-16T00:44:50.300ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3412024-11-16T00:44:50.300ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3422024-11-16T00:44:50.300ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3432024-11-16T00:44:50.300ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3442024-11-16T00:44:50.300ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3452024-11-16T00:44:50.304ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ad7c66bd-0d53-43e9-89e8-86e0651ea05d) file = sled-agent/src/probe_manager.rs:231 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
3462024-11-16T00:44:50.335ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3472024-11-16T00:44:50.343ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b3e7398e-9645-46d0-a57a-4bd06e1408a3/crypt/zone file = sled-storage/src/dataset.rs:303
3482024-11-16T00:44:50.513ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b3e7398e-9645-46d0-a57a-4bd06e1408a3 file = sled-storage/src/dataset.rs:389
3492024-11-16T00:44:50.521ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3502024-11-16T00:44:50.521ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3512024-11-16T00:44:50.521ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3522024-11-16T00:44:50.521ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3532024-11-16T00:44:50.521ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3542024-11-16T00:44:50.530ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3552024-11-16T00:44:50.530ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool)
3562024-11-16T00:44:50.624ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }
3572024-11-16T00:44:50.632ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3582024-11-16T00:44:50.632ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3592024-11-16T00:44:50.632ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3602024-11-16T00:44:50.632ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3612024-11-16T00:44:50.632ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3622024-11-16T00:44:50.632ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3632024-11-16T00:44:50.632ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3642024-11-16T00:44:50.668ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3652024-11-16T00:44:50.677ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_eb288506-11eb-4ffc-bf84-f6c1550028b7/crypt/zone file = sled-storage/src/dataset.rs:303
3662024-11-16T00:44:50.853ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_eb288506-11eb-4ffc-bf84-f6c1550028b7 file = sled-storage/src/dataset.rs:389
3672024-11-16T00:44:50.861ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3682024-11-16T00:44:50.861ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3692024-11-16T00:44:50.861ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3702024-11-16T00:44:50.861ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3712024-11-16T00:44:50.861ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3722024-11-16T00:44:50.871ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3732024-11-16T00:44:50.871ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2df48cc0-997e-4c6b-92f6-f05e369b8ceb (zpool)
3742024-11-16T00:44:50.970ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2df48cc0-997e-4c6b-92f6-f05e369b8ceb (zpool), kind: External }
3752024-11-16T00:44:50.979ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3762024-11-16T00:44:50.979ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3772024-11-16T00:44:50.979ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3782024-11-16T00:44:50.979ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3792024-11-16T00:44:50.979ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3802024-11-16T00:44:50.979ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3812024-11-16T00:44:50.979ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3822024-11-16T00:44:51.014ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3832024-11-16T00:44:51.022ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2df48cc0-997e-4c6b-92f6-f05e369b8ceb/crypt/zone file = sled-storage/src/dataset.rs:303
3842024-11-16T00:44:51.199ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2df48cc0-997e-4c6b-92f6-f05e369b8ceb file = sled-storage/src/dataset.rs:389
3852024-11-16T00:44:51.208ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3862024-11-16T00:44:51.208ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3872024-11-16T00:44:51.208ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3882024-11-16T00:44:51.208ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3892024-11-16T00:44:51.208ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3902024-11-16T00:44:51.217ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3912024-11-16T00:44:51.217ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 769d1181-4cb2-4e0f-87be-d1b20a8a9c58 (zpool)
3922024-11-16T00:44:51.310ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 769d1181-4cb2-4e0f-87be-d1b20a8a9c58 (zpool), kind: External }
3932024-11-16T00:44:51.318ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3942024-11-16T00:44:51.318ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3952024-11-16T00:44:51.318ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3962024-11-16T00:44:51.318ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3972024-11-16T00:44:51.318ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3982024-11-16T00:44:51.318ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3992024-11-16T00:44:51.318ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4002024-11-16T00:44:51.321ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ad7c66bd-0d53-43e9-89e8-86e0651ea05d) file = sled-agent/src/probe_manager.rs:231 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
4012024-11-16T00:44:51.353ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4022024-11-16T00:44:51.361ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_769d1181-4cb2-4e0f-87be-d1b20a8a9c58/crypt/zone file = sled-storage/src/dataset.rs:303
4032024-11-16T00:44:51.542ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_769d1181-4cb2-4e0f-87be-d1b20a8a9c58 file = sled-storage/src/dataset.rs:389
4042024-11-16T00:44:51.548ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4052024-11-16T00:44:51.549ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4062024-11-16T00:44:51.549ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4072024-11-16T00:44:51.549ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4082024-11-16T00:44:51.549ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4092024-11-16T00:44:51.559ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4102024-11-16T00:44:51.559ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool)
4112024-11-16T00:44:51.666ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool), kind: External }
4122024-11-16T00:44:51.673ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4132024-11-16T00:44:51.673ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4142024-11-16T00:44:51.673ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4152024-11-16T00:44:51.673ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4162024-11-16T00:44:51.673ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4172024-11-16T00:44:51.673ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4182024-11-16T00:44:51.673ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4192024-11-16T00:44:51.708ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4202024-11-16T00:44:51.717ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ad26846d-9efb-4f49-8d19-f73f5a25617e/crypt/zone file = sled-storage/src/dataset.rs:303
4212024-11-16T00:44:51.898ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ad26846d-9efb-4f49-8d19-f73f5a25617e file = sled-storage/src/dataset.rs:389
4222024-11-16T00:44:51.906ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4232024-11-16T00:44:51.906ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4242024-11-16T00:44:51.906ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4252024-11-16T00:44:51.906ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4262024-11-16T00:44:51.906ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4272024-11-16T00:44:51.915ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4282024-11-16T00:44:51.915ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool)
4292024-11-16T00:44:52.012ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }
4302024-11-16T00:44:52.023ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4312024-11-16T00:44:52.023ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4322024-11-16T00:44:52.023ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4332024-11-16T00:44:52.023ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4342024-11-16T00:44:52.023ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4352024-11-16T00:44:52.023ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4362024-11-16T00:44:52.023ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4372024-11-16T00:44:52.061ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4382024-11-16T00:44:52.069ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_96d0d34c-625d-45e2-b0db-1fbc7541f944/crypt/zone file = sled-storage/src/dataset.rs:303
4392024-11-16T00:44:52.236ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_96d0d34c-625d-45e2-b0db-1fbc7541f944 file = sled-storage/src/dataset.rs:389
4402024-11-16T00:44:52.244ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4412024-11-16T00:44:52.244ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4422024-11-16T00:44:52.244ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4432024-11-16T00:44:52.244ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 663efa11-5b34-43d6-b3ef-035ad0cb3d52 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cf590775-1e7e-4c57-848f-c6dd49cdc702 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2df48cc0-997e-4c6b-92f6-f05e369b8ceb (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 769d1181-4cb2-4e0f-87be-d1b20a8a9c58 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4442024-11-16T00:44:52.244ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4452024-11-16T00:44:52.244ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4462024-11-16T00:44:52.244ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4472024-11-16T00:44:52.244ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:888 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
4482024-11-16T00:44:52.244ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4492024-11-16T00:44:52.244ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:914 generation = Generation(1) sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
4502024-11-16T00:44:52.244ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:919 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
4512024-11-16T00:44:52.244ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:924 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
4522024-11-16T00:44:52.245ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
4532024-11-16T00:44:52.245ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:930 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
4542024-11-16T00:44:52.245ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4552024-11-16T00:44:52.245ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:935 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
4562024-11-16T00:44:52.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3622615 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:37039 req_id = 9a47dba3-48eb-416b-8e33-80cfc1aadff7 response_code = 200 uri = /omicron-physical-disks
4572024-11-16T00:44:52.276ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {03532d26-98b7-4731-ac60-2b2d8f362a0d (dataset): DatasetConfig { id: 03532d26-98b7-4731-ac60-2b2d8f362a0d (dataset), name: DatasetName { pool_name: ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 06f2df88-7bbf-4a0a-ae0a-eb1184a86fc9 (dataset): DatasetConfig { id: 06f2df88-7bbf-4a0a-ae0a-eb1184a86fc9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e316da7-3850-4167-8a56-b3bbf337ea75 (dataset): DatasetConfig { id: 0e316da7-3850-4167-8a56-b3bbf337ea75 (dataset), name: DatasetName { pool_name: ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0fdbe7b0-b2a8-44f5-a48f-045d0a535490 (dataset): DatasetConfig { id: 0fdbe7b0-b2a8-44f5-a48f-045d0a535490 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1128c03f-3e1d-4cd7-ade9-b170eb37fcbc (dataset): DatasetConfig { id: 1128c03f-3e1d-4cd7-ade9-b170eb37fcbc (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 16b1e634-683c-4198-b861-4dc781fcb96e (dataset): DatasetConfig { id: 16b1e634-683c-4198-b861-4dc781fcb96e (dataset), name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b76506b-7129-42cb-9a7b-45c3c5fdd625 (dataset): DatasetConfig { id: 1b76506b-7129-42cb-9a7b-45c3c5fdd625 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e33b2b1-edd1-4592-8113-b5cea77d0b96 (dataset): DatasetConfig { id: 1e33b2b1-edd1-4592-8113-b5cea77d0b96 (dataset), name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 20b5fffb-ac20-4ff4-80a9-6ae2b5448dee (dataset): DatasetConfig { id: 20b5fffb-ac20-4ff4-80a9-6ae2b5448dee (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 24904ba0-044a-497d-9389-64fe14c213be (dataset): DatasetConfig { id: 24904ba0-044a-497d-9389-64fe14c213be (dataset), name: DatasetName { pool_name: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2b9ecab9-ee5f-49d7-ad07-3b9bad250c6c (dataset): DatasetConfig { id: 2b9ecab9-ee5f-49d7-ad07-3b9bad250c6c (dataset), name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37348bef-9c89-49c0-8c03-26c6d5daec76 (dataset): DatasetConfig { id: 37348bef-9c89-49c0-8c03-26c6d5daec76 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3adb2c95-233d-490c-bddb-f5d09fd18436 (dataset): DatasetConfig { id: 3adb2c95-233d-490c-bddb-f5d09fd18436 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d415210-7028-4ea0-967a-26fd3dbaac32 (dataset): DatasetConfig { id: 3d415210-7028-4ea0-967a-26fd3dbaac32 (dataset), name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45cc6c8d-3e74-4be5-87f1-9b9377c5ff08 (dataset): DatasetConfig { id: 45cc6c8d-3e74-4be5-87f1-9b9377c5ff08 (dataset), name: DatasetName { pool_name: ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 48e77ca5-ee42-4787-84c9-b9cbdab00ace (dataset): DatasetConfig { id: 48e77ca5-ee42-4787-84c9-b9cbdab00ace (dataset), name: DatasetName { pool_name: ZpoolName { id: 2df48cc0-997e-4c6b-92f6-f05e369b8ceb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e3a9448-9582-4ab4-b029-24fd9e977d12 (dataset): DatasetConfig { id: 4e3a9448-9582-4ab4-b029-24fd9e977d12 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51e0b63d-8d79-4392-828c-e684f7e182ca (dataset): DatasetConfig { id: 51e0b63d-8d79-4392-828c-e684f7e182ca (dataset), name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5bf1a127-f929-452f-9beb-8afd46c4f7bf (dataset): DatasetConfig { id: 5bf1a127-f929-452f-9beb-8afd46c4f7bf (dataset), name: DatasetName { pool_name: ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5c6b2bcd-668c-4b93-b7d6-b83d771479c5 (dataset): DatasetConfig { id: 5c6b2bcd-668c-4b93-b7d6-b83d771479c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2df48cc0-997e-4c6b-92f6-f05e369b8ceb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f10c571-2481-4e61-921b-a8a1613733c7 (dataset): DatasetConfig { id: 5f10c571-2481-4e61-921b-a8a1613733c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6144d7c8-7066-4dfe-bd39-912e1ca107d0 (dataset): DatasetConfig { id: 6144d7c8-7066-4dfe-bd39-912e1ca107d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 769d1181-4cb2-4e0f-87be-d1b20a8a9c58 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61f5a593-7f7d-4cf5-8d3a-12a37b26bc53 (dataset): DatasetConfig { id: 61f5a593-7f7d-4cf5-8d3a-12a37b26bc53 (dataset), name: DatasetName { pool_name: ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 64ba14ac-8a6a-4c5e-8374-dc7788c83592 (dataset): DatasetConfig { id: 64ba14ac-8a6a-4c5e-8374-dc7788c83592 (dataset), name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b9ddc63-c4cc-44f9-843d-c43544f9f889 (dataset): DatasetConfig { id: 6b9ddc63-c4cc-44f9-843d-c43544f9f889 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2df48cc0-997e-4c6b-92f6-f05e369b8ceb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6bc8259d-c555-4e29-abe6-8e0895122487 (dataset): DatasetConfig { id: 6bc8259d-c555-4e29-abe6-8e0895122487 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2df48cc0-997e-4c6b-92f6-f05e369b8ceb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 73fc84c0-1433-420a-b04c-7b74b82ce35e (dataset): DatasetConfig { id: 73fc84c0-1433-420a-b04c-7b74b82ce35e (dataset), name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 746fa842-3520-42e9-a76e-70f37649ce5d (dataset): DatasetConfig { id: 746fa842-3520-42e9-a76e-70f37649ce5d (dataset), name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 79e60da4-c271-4552-beaf-0ad2fe763f0b (dataset): DatasetConfig { id: 79e60da4-c271-4552-beaf-0ad2fe763f0b (dataset), name: DatasetName { pool_name: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b0ae930-8410-463f-8717-b62c4e4e0757 (dataset): DatasetConfig { id: 7b0ae930-8410-463f-8717-b62c4e4e0757 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8734ecd6-aab9-4378-8de2-d344c4149659 (dataset): DatasetConfig { id: 8734ecd6-aab9-4378-8de2-d344c4149659 (dataset), name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8cfbb938-d458-4f29-ae62-e05a7b94fffb (dataset): DatasetConfig { id: 8cfbb938-d458-4f29-ae62-e05a7b94fffb (dataset), name: DatasetName { pool_name: ZpoolName { id: 769d1181-4cb2-4e0f-87be-d1b20a8a9c58 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8dfe2dd0-721c-4859-90e8-e5471b101cc9 (dataset): DatasetConfig { id: 8dfe2dd0-721c-4859-90e8-e5471b101cc9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e7f6528-5a93-4bf9-957d-538d3ba2d17b (dataset): DatasetConfig { id: 8e7f6528-5a93-4bf9-957d-538d3ba2d17b (dataset), name: DatasetName { pool_name: ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8fd28da2-5274-4392-8f04-34ea30597440 (dataset): DatasetConfig { id: 8fd28da2-5274-4392-8f04-34ea30597440 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 900524f6-6c83-4103-8bf9-f613566bfad6 (dataset): DatasetConfig { id: 900524f6-6c83-4103-8bf9-f613566bfad6 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92435a2a-4ee2-483a-8d8c-1a91858bd0d2 (dataset): DatasetConfig { id: 92435a2a-4ee2-483a-8d8c-1a91858bd0d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9aab6e4a-b1ea-4b0c-a586-ec2a5fdb24cf (dataset): DatasetConfig { id: 9aab6e4a-b1ea-4b0c-a586-ec2a5fdb24cf (dataset), name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1b111a4-00d9-4431-8a89-637c75922c38 (dataset): DatasetConfig { id: a1b111a4-00d9-4431-8a89-637c75922c38 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a5319779-bded-413b-b92d-2312ff42240c (dataset): DatasetConfig { id: a5319779-bded-413b-b92d-2312ff42240c (dataset), name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa1402da-32ce-4802-bc82-75718312687f (dataset): DatasetConfig { id: aa1402da-32ce-4802-bc82-75718312687f (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae9ba52a-9622-44bf-97a2-5899db85edd3 (dataset): DatasetConfig { id: ae9ba52a-9622-44bf-97a2-5899db85edd3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b48280ea-2fbf-470f-b5b5-f7ee0ff6aca3 (dataset): DatasetConfig { id: b48280ea-2fbf-470f-b5b5-f7ee0ff6aca3 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b580c137-b712-46be-8e2a-f716adb14cb2 (dataset): DatasetConfig { id: b580c137-b712-46be-8e2a-f716adb14cb2 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5a746d0-fbb8-4f8d-8ea9-ecce9ae2988d (dataset): DatasetConfig { id: b5a746d0-fbb8-4f8d-8ea9-ecce9ae2988d (dataset), name: DatasetName { pool_name: ZpoolName { id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b74bd470-c416-47b1-8fa9-669381312603 (dataset): DatasetConfig { id: b74bd470-c416-47b1-8fa9-669381312603 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbc43360-db34-4cf7-9a01-1da48da9628a (dataset): DatasetConfig { id: bbc43360-db34-4cf7-9a01-1da48da9628a (dataset), name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, be563c29-4c8b-4907-b0e6-6483483fada4 (dataset): DatasetConfig { id: be563c29-4c8b-4907-b0e6-6483483fada4 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c00f042a-62da-45f8-825c-bbc4dbb843f2 (dataset): DatasetConfig { id: c00f042a-62da-45f8-825c-bbc4dbb843f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c2eb2123-7fe3-4696-95b0-5bce503511a8 (dataset): DatasetConfig { id: c2eb2123-7fe3-4696-95b0-5bce503511a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 769d1181-4cb2-4e0f-87be-d1b20a8a9c58 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c4dab80b-fa4b-43a1-8611-b5fc59fb9b95 (dataset): DatasetConfig { id: c4dab80b-fa4b-43a1-8611-b5fc59fb9b95 (dataset), name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c59fa318-d901-4c53-9c2a-e6e679789e4e (dataset): DatasetConfig { id: c59fa318-d901-4c53-9c2a-e6e679789e4e (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c7003532-055e-47c1-9512-6c87a0c1ead4 (dataset): DatasetConfig { id: c7003532-055e-47c1-9512-6c87a0c1ead4 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c8847bf4-77e8-4062-a9ca-8b4b9aeb6a6d (dataset): DatasetConfig { id: c8847bf4-77e8-4062-a9ca-8b4b9aeb6a6d (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce8b14d0-d176-4059-9445-0e276e0f4ba1 (dataset): DatasetConfig { id: ce8b14d0-d176-4059-9445-0e276e0f4ba1 (dataset), name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d18022f8-4dca-4ecb-8406-d0b6d130fef5 (dataset): DatasetConfig { id: d18022f8-4dca-4ecb-8406-d0b6d130fef5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df0a909d-ea29-449c-8e33-26576ebfc72a (dataset): DatasetConfig { id: df0a909d-ea29-449c-8e33-26576ebfc72a (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e026dac1-86da-497a-ac7c-597656afcca2 (dataset): DatasetConfig { id: e026dac1-86da-497a-ac7c-597656afcca2 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e1db3c82-1a8e-47f8-baa0-2ef03ebcab3c (dataset): DatasetConfig { id: e1db3c82-1a8e-47f8-baa0-2ef03ebcab3c (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e4190c52-e16c-4123-98b7-c880ac08d492 (dataset): DatasetConfig { id: e4190c52-e16c-4123-98b7-c880ac08d492 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e43bc40e-22f5-4fbf-b0d0-b9cfa25aba71 (dataset): DatasetConfig { id: e43bc40e-22f5-4fbf-b0d0-b9cfa25aba71 (dataset), name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7238bd3-45de-41fa-8913-1d7833566b5d (dataset): DatasetConfig { id: e7238bd3-45de-41fa-8913-1d7833566b5d (dataset), name: DatasetName { pool_name: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ebf4c708-a104-4533-af22-1cb48b1690ee (dataset): DatasetConfig { id: ebf4c708-a104-4533-af22-1cb48b1690ee (dataset), name: DatasetName { pool_name: ZpoolName { id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ef01abcf-b8f9-4b63-b4de-5d9f78feda0d (dataset): DatasetConfig { id: ef01abcf-b8f9-4b63-b4de-5d9f78feda0d (dataset), name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f691651c-28dc-45a2-8030-d4780934d768 (dataset): DatasetConfig { id: f691651c-28dc-45a2-8030-d4780934d768 (dataset), name: DatasetName { pool_name: ZpoolName { id: 769d1181-4cb2-4e0f-87be-d1b20a8a9c58 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fd64e72c-d59a-4105-8519-5cd36e5d9993 (dataset): DatasetConfig { id: fd64e72c-d59a-4105-8519-5cd36e5d9993 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:457 sled_address = [fd00:1122:3344:101::1]:12345
4582024-11-16T00:44:52.276ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36974
4592024-11-16T00:44:52.277ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:850 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
4602024-11-16T00:44:52.277ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {03532d26-98b7-4731-ac60-2b2d8f362a0d (dataset): DatasetConfig { id: 03532d26-98b7-4731-ac60-2b2d8f362a0d (dataset), name: DatasetName { pool_name: ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 06f2df88-7bbf-4a0a-ae0a-eb1184a86fc9 (dataset): DatasetConfig { id: 06f2df88-7bbf-4a0a-ae0a-eb1184a86fc9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e316da7-3850-4167-8a56-b3bbf337ea75 (dataset): DatasetConfig { id: 0e316da7-3850-4167-8a56-b3bbf337ea75 (dataset), name: DatasetName { pool_name: ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0fdbe7b0-b2a8-44f5-a48f-045d0a535490 (dataset): DatasetConfig { id: 0fdbe7b0-b2a8-44f5-a48f-045d0a535490 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1128c03f-3e1d-4cd7-ade9-b170eb37fcbc (dataset): DatasetConfig { id: 1128c03f-3e1d-4cd7-ade9-b170eb37fcbc (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 16b1e634-683c-4198-b861-4dc781fcb96e (dataset): DatasetConfig { id: 16b1e634-683c-4198-b861-4dc781fcb96e (dataset), name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b76506b-7129-42cb-9a7b-45c3c5fdd625 (dataset): DatasetConfig { id: 1b76506b-7129-42cb-9a7b-45c3c5fdd625 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e33b2b1-edd1-4592-8113-b5cea77d0b96 (dataset): DatasetConfig { id: 1e33b2b1-edd1-4592-8113-b5cea77d0b96 (dataset), name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 20b5fffb-ac20-4ff4-80a9-6ae2b5448dee (dataset): DatasetConfig { id: 20b5fffb-ac20-4ff4-80a9-6ae2b5448dee (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 24904ba0-044a-497d-9389-64fe14c213be (dataset): DatasetConfig { id: 24904ba0-044a-497d-9389-64fe14c213be (dataset), name: DatasetName { pool_name: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2b9ecab9-ee5f-49d7-ad07-3b9bad250c6c (dataset): DatasetConfig { id: 2b9ecab9-ee5f-49d7-ad07-3b9bad250c6c (dataset), name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37348bef-9c89-49c0-8c03-26c6d5daec76 (dataset): DatasetConfig { id: 37348bef-9c89-49c0-8c03-26c6d5daec76 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3adb2c95-233d-490c-bddb-f5d09fd18436 (dataset): DatasetConfig { id: 3adb2c95-233d-490c-bddb-f5d09fd18436 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d415210-7028-4ea0-967a-26fd3dbaac32 (dataset): DatasetConfig { id: 3d415210-7028-4ea0-967a-26fd3dbaac32 (dataset), name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45cc6c8d-3e74-4be5-87f1-9b9377c5ff08 (dataset): DatasetConfig { id: 45cc6c8d-3e74-4be5-87f1-9b9377c5ff08 (dataset), name: DatasetName { pool_name: ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 48e77ca5-ee42-4787-84c9-b9cbdab00ace (dataset): DatasetConfig { id: 48e77ca5-ee42-4787-84c9-b9cbdab00ace (dataset), name: DatasetName { pool_name: ZpoolName { id: 2df48cc0-997e-4c6b-92f6-f05e369b8ceb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e3a9448-9582-4ab4-b029-24fd9e977d12 (dataset): DatasetConfig { id: 4e3a9448-9582-4ab4-b029-24fd9e977d12 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51e0b63d-8d79-4392-828c-e684f7e182ca (dataset): DatasetConfig { id: 51e0b63d-8d79-4392-828c-e684f7e182ca (dataset), name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5bf1a127-f929-452f-9beb-8afd46c4f7bf (dataset): DatasetConfig { id: 5bf1a127-f929-452f-9beb-8afd46c4f7bf (dataset), name: DatasetName { pool_name: ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5c6b2bcd-668c-4b93-b7d6-b83d771479c5 (dataset): DatasetConfig { id: 5c6b2bcd-668c-4b93-b7d6-b83d771479c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2df48cc0-997e-4c6b-92f6-f05e369b8ceb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f10c571-2481-4e61-921b-a8a1613733c7 (dataset): DatasetConfig { id: 5f10c571-2481-4e61-921b-a8a1613733c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6144d7c8-7066-4dfe-bd39-912e1ca107d0 (dataset): DatasetConfig { id: 6144d7c8-7066-4dfe-bd39-912e1ca107d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 769d1181-4cb2-4e0f-87be-d1b20a8a9c58 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61f5a593-7f7d-4cf5-8d3a-12a37b26bc53 (dataset): DatasetConfig { id: 61f5a593-7f7d-4cf5-8d3a-12a37b26bc53 (dataset), name: DatasetName { pool_name: ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 64ba14ac-8a6a-4c5e-8374-dc7788c83592 (dataset): DatasetConfig { id: 64ba14ac-8a6a-4c5e-8374-dc7788c83592 (dataset), name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b9ddc63-c4cc-44f9-843d-c43544f9f889 (dataset): DatasetConfig { id: 6b9ddc63-c4cc-44f9-843d-c43544f9f889 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2df48cc0-997e-4c6b-92f6-f05e369b8ceb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6bc8259d-c555-4e29-abe6-8e0895122487 (dataset): DatasetConfig { id: 6bc8259d-c555-4e29-abe6-8e0895122487 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2df48cc0-997e-4c6b-92f6-f05e369b8ceb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 73fc84c0-1433-420a-b04c-7b74b82ce35e (dataset): DatasetConfig { id: 73fc84c0-1433-420a-b04c-7b74b82ce35e (dataset), name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 746fa842-3520-42e9-a76e-70f37649ce5d (dataset): DatasetConfig { id: 746fa842-3520-42e9-a76e-70f37649ce5d (dataset), name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 79e60da4-c271-4552-beaf-0ad2fe763f0b (dataset): DatasetConfig { id: 79e60da4-c271-4552-beaf-0ad2fe763f0b (dataset), name: DatasetName { pool_name: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b0ae930-8410-463f-8717-b62c4e4e0757 (dataset): DatasetConfig { id: 7b0ae930-8410-463f-8717-b62c4e4e0757 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8734ecd6-aab9-4378-8de2-d344c4149659 (dataset): DatasetConfig { id: 8734ecd6-aab9-4378-8de2-d344c4149659 (dataset), name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8cfbb938-d458-4f29-ae62-e05a7b94fffb (dataset): DatasetConfig { id: 8cfbb938-d458-4f29-ae62-e05a7b94fffb (dataset), name: DatasetName { pool_name: ZpoolName { id: 769d1181-4cb2-4e0f-87be-d1b20a8a9c58 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8dfe2dd0-721c-4859-90e8-e5471b101cc9 (dataset): DatasetConfig { id: 8dfe2dd0-721c-4859-90e8-e5471b101cc9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e7f6528-5a93-4bf9-957d-538d3ba2d17b (dataset): DatasetConfig { id: 8e7f6528-5a93-4bf9-957d-538d3ba2d17b (dataset), name: DatasetName { pool_name: ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8fd28da2-5274-4392-8f04-34ea30597440 (dataset): DatasetConfig { id: 8fd28da2-5274-4392-8f04-34ea30597440 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 900524f6-6c83-4103-8bf9-f613566bfad6 (dataset): DatasetConfig { id: 900524f6-6c83-4103-8bf9-f613566bfad6 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92435a2a-4ee2-483a-8d8c-1a91858bd0d2 (dataset): DatasetConfig { id: 92435a2a-4ee2-483a-8d8c-1a91858bd0d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9aab6e4a-b1ea-4b0c-a586-ec2a5fdb24cf (dataset): DatasetConfig { id: 9aab6e4a-b1ea-4b0c-a586-ec2a5fdb24cf (dataset), name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1b111a4-00d9-4431-8a89-637c75922c38 (dataset): DatasetConfig { id: a1b111a4-00d9-4431-8a89-637c75922c38 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a5319779-bded-413b-b92d-2312ff42240c (dataset): DatasetConfig { id: a5319779-bded-413b-b92d-2312ff42240c (dataset), name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa1402da-32ce-4802-bc82-75718312687f (dataset): DatasetConfig { id: aa1402da-32ce-4802-bc82-75718312687f (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae9ba52a-9622-44bf-97a2-5899db85edd3 (dataset): DatasetConfig { id: ae9ba52a-9622-44bf-97a2-5899db85edd3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b48280ea-2fbf-470f-b5b5-f7ee0ff6aca3 (dataset): DatasetConfig { id: b48280ea-2fbf-470f-b5b5-f7ee0ff6aca3 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b580c137-b712-46be-8e2a-f716adb14cb2 (dataset): DatasetConfig { id: b580c137-b712-46be-8e2a-f716adb14cb2 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5a746d0-fbb8-4f8d-8ea9-ecce9ae2988d (dataset): DatasetConfig { id: b5a746d0-fbb8-4f8d-8ea9-ecce9ae2988d (dataset), name: DatasetName { pool_name: ZpoolName { id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b74bd470-c416-47b1-8fa9-669381312603 (dataset): DatasetConfig { id: b74bd470-c416-47b1-8fa9-669381312603 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbc43360-db34-4cf7-9a01-1da48da9628a (dataset): DatasetConfig { id: bbc43360-db34-4cf7-9a01-1da48da9628a (dataset), name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, be563c29-4c8b-4907-b0e6-6483483fada4 (dataset): DatasetConfig { id: be563c29-4c8b-4907-b0e6-6483483fada4 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c00f042a-62da-45f8-825c-bbc4dbb843f2 (dataset): DatasetConfig { id: c00f042a-62da-45f8-825c-bbc4dbb843f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c2eb2123-7fe3-4696-95b0-5bce503511a8 (dataset): DatasetConfig { id: c2eb2123-7fe3-4696-95b0-5bce503511a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 769d1181-4cb2-4e0f-87be-d1b20a8a9c58 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c4dab80b-fa4b-43a1-8611-b5fc59fb9b95 (dataset): DatasetConfig { id: c4dab80b-fa4b-43a1-8611-b5fc59fb9b95 (dataset), name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c59fa318-d901-4c53-9c2a-e6e679789e4e (dataset): DatasetConfig { id: c59fa318-d901-4c53-9c2a-e6e679789e4e (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c7003532-055e-47c1-9512-6c87a0c1ead4 (dataset): DatasetConfig { id: c7003532-055e-47c1-9512-6c87a0c1ead4 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c8847bf4-77e8-4062-a9ca-8b4b9aeb6a6d (dataset): DatasetConfig { id: c8847bf4-77e8-4062-a9ca-8b4b9aeb6a6d (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce8b14d0-d176-4059-9445-0e276e0f4ba1 (dataset): DatasetConfig { id: ce8b14d0-d176-4059-9445-0e276e0f4ba1 (dataset), name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d18022f8-4dca-4ecb-8406-d0b6d130fef5 (dataset): DatasetConfig { id: d18022f8-4dca-4ecb-8406-d0b6d130fef5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df0a909d-ea29-449c-8e33-26576ebfc72a (dataset): DatasetConfig { id: df0a909d-ea29-449c-8e33-26576ebfc72a (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e026dac1-86da-497a-ac7c-597656afcca2 (dataset): DatasetConfig { id: e026dac1-86da-497a-ac7c-597656afcca2 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e1db3c82-1a8e-47f8-baa0-2ef03ebcab3c (dataset): DatasetConfig { id: e1db3c82-1a8e-47f8-baa0-2ef03ebcab3c (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e4190c52-e16c-4123-98b7-c880ac08d492 (dataset): DatasetConfig { id: e4190c52-e16c-4123-98b7-c880ac08d492 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e43bc40e-22f5-4fbf-b0d0-b9cfa25aba71 (dataset): DatasetConfig { id: e43bc40e-22f5-4fbf-b0d0-b9cfa25aba71 (dataset), name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7238bd3-45de-41fa-8913-1d7833566b5d (dataset): DatasetConfig { id: e7238bd3-45de-41fa-8913-1d7833566b5d (dataset), name: DatasetName { pool_name: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ebf4c708-a104-4533-af22-1cb48b1690ee (dataset): DatasetConfig { id: ebf4c708-a104-4533-af22-1cb48b1690ee (dataset), name: DatasetName { pool_name: ZpoolName { id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ef01abcf-b8f9-4b63-b4de-5d9f78feda0d (dataset): DatasetConfig { id: ef01abcf-b8f9-4b63-b4de-5d9f78feda0d (dataset), name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f691651c-28dc-45a2-8030-d4780934d768 (dataset): DatasetConfig { id: f691651c-28dc-45a2-8030-d4780934d768 (dataset), name: DatasetName { pool_name: ZpoolName { id: 769d1181-4cb2-4e0f-87be-d1b20a8a9c58 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fd64e72c-d59a-4105-8519-5cd36e5d9993 (dataset): DatasetConfig { id: fd64e72c-d59a-4105-8519-5cd36e5d9993 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4612024-11-16T00:44:52.277ZINFOSledAgent (StorageManager): No ledger in /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4622024-11-16T00:44:52.277ZINFOSledAgent (StorageManager): No ledger in /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4632024-11-16T00:44:52.277ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4642024-11-16T00:44:52.277ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4652024-11-16T00:44:52.277ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/96d0d34c-625d-45e2-b0db-1fbc7541f944/crypt/zone/oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2"), full_name: "oxp_96d0d34c-625d-45e2-b0db-1fbc7541f944/crypt/zone/oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2" } file = sled-storage/src/manager.rs:1331
4662024-11-16T00:44:52.324ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ad7c66bd-0d53-43e9-89e8-86e0651ea05d) file = sled-agent/src/probe_manager.rs:231 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
4672024-11-16T00:44:52.381ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4682024-11-16T00:44:52.381ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/220cf814-be1b-400b-bb43-5ab45b7eb044/crypt/zone/oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a"), full_name: "oxp_220cf814-be1b-400b-bb43-5ab45b7eb044/crypt/zone/oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a" } file = sled-storage/src/manager.rs:1331
4692024-11-16T00:44:52.480ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4702024-11-16T00:44:52.480ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_96d0d34c-625d-45e2-b0db-1fbc7541f944/crucible" } file = sled-storage/src/manager.rs:1331
4712024-11-16T00:44:52.571ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4722024-11-16T00:44:52.571ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3e7398e-9645-46d0-a57a-4bd06e1408a3/crypt/zone/oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89"), full_name: "oxp_b3e7398e-9645-46d0-a57a-4bd06e1408a3/crypt/zone/oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89" } file = sled-storage/src/manager.rs:1331
4732024-11-16T00:44:52.669ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4742024-11-16T00:44:52.669ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
4752024-11-16T00:44:52.759ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4762024-11-16T00:44:52.759ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/220cf814-be1b-400b-bb43-5ab45b7eb044/crypt/zone/oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a"), full_name: "oxp_220cf814-be1b-400b-bb43-5ab45b7eb044/crypt/zone/oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a" } file = sled-storage/src/manager.rs:1331
4772024-11-16T00:44:52.860ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4782024-11-16T00:44:52.860ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crypt/zone/oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1"), full_name: "oxp_8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crypt/zone/oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1" } file = sled-storage/src/manager.rs:1331
4792024-11-16T00:44:52.959ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4802024-11-16T00:44:52.960ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d49e8c8c-eb53-43b6-a176-aee4725796df/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4812024-11-16T00:44:53.054ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4822024-11-16T00:44:53.054ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crypt/zone/oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29"), full_name: "oxp_8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crypt/zone/oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29" } file = sled-storage/src/manager.rs:1331
4832024-11-16T00:44:53.154ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4842024-11-16T00:44:53.154ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eb288506-11eb-4ffc-bf84-f6c1550028b7/crypt/debug"), full_name: "oxp_eb288506-11eb-4ffc-bf84-f6c1550028b7/crypt/debug" } file = sled-storage/src/manager.rs:1331
4852024-11-16T00:44:53.222ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4862024-11-16T00:44:53.222ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/220cf814-be1b-400b-bb43-5ab45b7eb044/crypt/zone/oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679"), full_name: "oxp_220cf814-be1b-400b-bb43-5ab45b7eb044/crypt/zone/oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679" } file = sled-storage/src/manager.rs:1331
4872024-11-16T00:44:53.322ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4882024-11-16T00:44:53.322ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
4892024-11-16T00:44:53.327ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ad7c66bd-0d53-43e9-89e8-86e0651ea05d) file = sled-agent/src/probe_manager.rs:231 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
4902024-11-16T00:44:53.412ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4912024-11-16T00:44:53.412ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eb288506-11eb-4ffc-bf84-f6c1550028b7/crypt/zone"), full_name: "oxp_eb288506-11eb-4ffc-bf84-f6c1550028b7/crypt/zone" } file = sled-storage/src/manager.rs:1331
4922024-11-16T00:44:53.483ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4932024-11-16T00:44:53.483ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_220cf814-be1b-400b-bb43-5ab45b7eb044/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
4942024-11-16T00:44:53.572ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4952024-11-16T00:44:53.572ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/96d0d34c-625d-45e2-b0db-1fbc7541f944/crypt/zone"), full_name: "oxp_96d0d34c-625d-45e2-b0db-1fbc7541f944/crypt/zone" } file = sled-storage/src/manager.rs:1331
4962024-11-16T00:44:53.638ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4972024-11-16T00:44:53.638ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2df48cc0-997e-4c6b-92f6-f05e369b8ceb/crypt/zone/oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3"), full_name: "oxp_2df48cc0-997e-4c6b-92f6-f05e369b8ceb/crypt/zone/oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3" } file = sled-storage/src/manager.rs:1331
4982024-11-16T00:44:53.733ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4992024-11-16T00:44:53.733ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3e7398e-9645-46d0-a57a-4bd06e1408a3/crypt/zone/oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b"), full_name: "oxp_b3e7398e-9645-46d0-a57a-4bd06e1408a3/crypt/zone/oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b" } file = sled-storage/src/manager.rs:1331
5002024-11-16T00:44:53.828ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5012024-11-16T00:44:53.828ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d49e8c8c-eb53-43b6-a176-aee4725796df/crypt/zone"), full_name: "oxp_d49e8c8c-eb53-43b6-a176-aee4725796df/crypt/zone" } file = sled-storage/src/manager.rs:1331
5022024-11-16T00:44:53.896ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5032024-11-16T00:44:53.896ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/96d0d34c-625d-45e2-b0db-1fbc7541f944/crypt/zone/oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6"), full_name: "oxp_96d0d34c-625d-45e2-b0db-1fbc7541f944/crypt/zone/oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6" } file = sled-storage/src/manager.rs:1331
5042024-11-16T00:44:53.994ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5052024-11-16T00:44:53.994ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2df48cc0-997e-4c6b-92f6-f05e369b8ceb/crucible" } file = sled-storage/src/manager.rs:1331
5062024-11-16T00:44:54.085ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5072024-11-16T00:44:54.085ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
5082024-11-16T00:44:54.175ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5092024-11-16T00:44:54.175ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/769d1181-4cb2-4e0f-87be-d1b20a8a9c58/crypt/zone/oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9"), full_name: "oxp_769d1181-4cb2-4e0f-87be-d1b20a8a9c58/crypt/zone/oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9" } file = sled-storage/src/manager.rs:1331
5102024-11-16T00:44:54.275ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5112024-11-16T00:44:54.275ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/96d0d34c-625d-45e2-b0db-1fbc7541f944/crypt/debug"), full_name: "oxp_96d0d34c-625d-45e2-b0db-1fbc7541f944/crypt/debug" } file = sled-storage/src/manager.rs:1331
5122024-11-16T00:44:54.329ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ad7c66bd-0d53-43e9-89e8-86e0651ea05d) file = sled-agent/src/probe_manager.rs:231 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
5132024-11-16T00:44:54.343ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5142024-11-16T00:44:54.343ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d49e8c8c-eb53-43b6-a176-aee4725796df/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5152024-11-16T00:44:54.432ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5162024-11-16T00:44:54.432ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2df48cc0-997e-4c6b-92f6-f05e369b8ceb/crypt/debug"), full_name: "oxp_2df48cc0-997e-4c6b-92f6-f05e369b8ceb/crypt/debug" } file = sled-storage/src/manager.rs:1331
5172024-11-16T00:44:54.499ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5182024-11-16T00:44:54.499ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2df48cc0-997e-4c6b-92f6-f05e369b8ceb/crypt/zone"), full_name: "oxp_2df48cc0-997e-4c6b-92f6-f05e369b8ceb/crypt/zone" } file = sled-storage/src/manager.rs:1331
5192024-11-16T00:44:54.567ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5202024-11-16T00:44:54.567ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/220cf814-be1b-400b-bb43-5ab45b7eb044/crypt/zone"), full_name: "oxp_220cf814-be1b-400b-bb43-5ab45b7eb044/crypt/zone" } file = sled-storage/src/manager.rs:1331
5212024-11-16T00:44:54.635ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5222024-11-16T00:44:54.635ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d49e8c8c-eb53-43b6-a176-aee4725796df/crypt/zone/oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888"), full_name: "oxp_d49e8c8c-eb53-43b6-a176-aee4725796df/crypt/zone/oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888" } file = sled-storage/src/manager.rs:1331
5232024-11-16T00:44:54.736ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5242024-11-16T00:44:54.736ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_eb288506-11eb-4ffc-bf84-f6c1550028b7/crucible" } file = sled-storage/src/manager.rs:1331
5252024-11-16T00:44:54.821ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5262024-11-16T00:44:54.821ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad26846d-9efb-4f49-8d19-f73f5a25617e/crypt/zone/oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36"), full_name: "oxp_ad26846d-9efb-4f49-8d19-f73f5a25617e/crypt/zone/oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36" } file = sled-storage/src/manager.rs:1331
5272024-11-16T00:44:54.919ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5282024-11-16T00:44:54.919ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/220cf814-be1b-400b-bb43-5ab45b7eb044/crypt/debug"), full_name: "oxp_220cf814-be1b-400b-bb43-5ab45b7eb044/crypt/debug" } file = sled-storage/src/manager.rs:1331
5292024-11-16T00:44:54.987ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5302024-11-16T00:44:54.987ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/769d1181-4cb2-4e0f-87be-d1b20a8a9c58/crypt/zone"), full_name: "oxp_769d1181-4cb2-4e0f-87be-d1b20a8a9c58/crypt/zone" } file = sled-storage/src/manager.rs:1331
5312024-11-16T00:44:55.056ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5322024-11-16T00:44:55.056ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5332024-11-16T00:44:55.146ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5342024-11-16T00:44:55.146ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/96d0d34c-625d-45e2-b0db-1fbc7541f944/crypt/zone/oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e"), full_name: "oxp_96d0d34c-625d-45e2-b0db-1fbc7541f944/crypt/zone/oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e" } file = sled-storage/src/manager.rs:1331
5352024-11-16T00:44:55.245ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5362024-11-16T00:44:55.245ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crypt/zone"), full_name: "oxp_8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crypt/zone" } file = sled-storage/src/manager.rs:1331
5372024-11-16T00:44:55.315ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5382024-11-16T00:44:55.315ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3e7398e-9645-46d0-a57a-4bd06e1408a3/crypt/zone"), full_name: "oxp_b3e7398e-9645-46d0-a57a-4bd06e1408a3/crypt/zone" } file = sled-storage/src/manager.rs:1331
5392024-11-16T00:44:55.331ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ad7c66bd-0d53-43e9-89e8-86e0651ea05d) file = sled-agent/src/probe_manager.rs:231 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
5402024-11-16T00:44:55.382ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5412024-11-16T00:44:55.382ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d49e8c8c-eb53-43b6-a176-aee4725796df/crypt/zone/oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490"), full_name: "oxp_d49e8c8c-eb53-43b6-a176-aee4725796df/crypt/zone/oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490" } file = sled-storage/src/manager.rs:1331
5422024-11-16T00:44:55.484ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5432024-11-16T00:44:55.484ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_220cf814-be1b-400b-bb43-5ab45b7eb044/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5442024-11-16T00:44:55.576ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5452024-11-16T00:44:55.576ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crypt/zone/oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd"), full_name: "oxp_8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crypt/zone/oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd" } file = sled-storage/src/manager.rs:1331
5462024-11-16T00:44:55.675ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5472024-11-16T00:44:55.675ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d49e8c8c-eb53-43b6-a176-aee4725796df/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5482024-11-16T00:44:55.765ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5492024-11-16T00:44:55.765ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3e7398e-9645-46d0-a57a-4bd06e1408a3/crypt/zone/oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b"), full_name: "oxp_b3e7398e-9645-46d0-a57a-4bd06e1408a3/crypt/zone/oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b" } file = sled-storage/src/manager.rs:1331
5502024-11-16T00:44:55.864ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5512024-11-16T00:44:55.864ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crucible" } file = sled-storage/src/manager.rs:1331
5522024-11-16T00:44:55.951ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5532024-11-16T00:44:55.951ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3e7398e-9645-46d0-a57a-4bd06e1408a3/crypt/zone/oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5"), full_name: "oxp_b3e7398e-9645-46d0-a57a-4bd06e1408a3/crypt/zone/oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5" } file = sled-storage/src/manager.rs:1331
5542024-11-16T00:44:56.049ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5552024-11-16T00:44:56.049ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad26846d-9efb-4f49-8d19-f73f5a25617e/crypt/zone"), full_name: "oxp_ad26846d-9efb-4f49-8d19-f73f5a25617e/crypt/zone" } file = sled-storage/src/manager.rs:1331
5562024-11-16T00:44:56.119ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5572024-11-16T00:44:56.119ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad26846d-9efb-4f49-8d19-f73f5a25617e/crypt/zone/oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96"), full_name: "oxp_ad26846d-9efb-4f49-8d19-f73f5a25617e/crypt/zone/oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96" } file = sled-storage/src/manager.rs:1331
5582024-11-16T00:44:56.220ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5592024-11-16T00:44:56.220ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ad26846d-9efb-4f49-8d19-f73f5a25617e/crucible" } file = sled-storage/src/manager.rs:1331
5602024-11-16T00:44:56.307ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5612024-11-16T00:44:56.307ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d49e8c8c-eb53-43b6-a176-aee4725796df/crypt/debug"), full_name: "oxp_d49e8c8c-eb53-43b6-a176-aee4725796df/crypt/debug" } file = sled-storage/src/manager.rs:1331
5622024-11-16T00:44:56.333ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ad7c66bd-0d53-43e9-89e8-86e0651ea05d) file = sled-agent/src/probe_manager.rs:231 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
5632024-11-16T00:44:56.374ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5642024-11-16T00:44:56.374ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eb288506-11eb-4ffc-bf84-f6c1550028b7/crypt/zone/oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b"), full_name: "oxp_eb288506-11eb-4ffc-bf84-f6c1550028b7/crypt/zone/oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b" } file = sled-storage/src/manager.rs:1331
5652024-11-16T00:44:56.475ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5662024-11-16T00:44:56.475ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d49e8c8c-eb53-43b6-a176-aee4725796df/crypt/zone/oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6"), full_name: "oxp_d49e8c8c-eb53-43b6-a176-aee4725796df/crypt/zone/oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6" } file = sled-storage/src/manager.rs:1331
5672024-11-16T00:44:56.574ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5682024-11-16T00:44:56.574ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_769d1181-4cb2-4e0f-87be-d1b20a8a9c58/crucible" } file = sled-storage/src/manager.rs:1331
5692024-11-16T00:44:56.681ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5702024-11-16T00:44:56.681ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d49e8c8c-eb53-43b6-a176-aee4725796df/crypt/zone/oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee"), full_name: "oxp_d49e8c8c-eb53-43b6-a176-aee4725796df/crypt/zone/oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee" } file = sled-storage/src/manager.rs:1331
5712024-11-16T00:44:56.785ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5722024-11-16T00:44:56.785ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crypt/debug"), full_name: "oxp_8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crypt/debug" } file = sled-storage/src/manager.rs:1331
5732024-11-16T00:44:56.854ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5742024-11-16T00:44:56.854ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3e7398e-9645-46d0-a57a-4bd06e1408a3/crypt/debug"), full_name: "oxp_b3e7398e-9645-46d0-a57a-4bd06e1408a3/crypt/debug" } file = sled-storage/src/manager.rs:1331
5752024-11-16T00:44:56.924ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5762024-11-16T00:44:56.924ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crypt/zone/oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3"), full_name: "oxp_8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crypt/zone/oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3" } file = sled-storage/src/manager.rs:1331
5772024-11-16T00:44:57.025ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5782024-11-16T00:44:57.026ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d49e8c8c-eb53-43b6-a176-aee4725796df/crypt/zone/oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a"), full_name: "oxp_d49e8c8c-eb53-43b6-a176-aee4725796df/crypt/zone/oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a" } file = sled-storage/src/manager.rs:1331
5792024-11-16T00:44:57.089ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 14.585268405s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
5802024-11-16T00:44:57.126ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5812024-11-16T00:44:57.126ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crypt/zone/oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf"), full_name: "oxp_8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crypt/zone/oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf" } file = sled-storage/src/manager.rs:1331
5822024-11-16T00:44:57.226ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5832024-11-16T00:44:57.226ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b3e7398e-9645-46d0-a57a-4bd06e1408a3/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5842024-11-16T00:44:57.317ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5852024-11-16T00:44:57.317ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3e7398e-9645-46d0-a57a-4bd06e1408a3/crypt/zone/oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214"), full_name: "oxp_b3e7398e-9645-46d0-a57a-4bd06e1408a3/crypt/zone/oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214" } file = sled-storage/src/manager.rs:1331
5862024-11-16T00:44:57.335ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ad7c66bd-0d53-43e9-89e8-86e0651ea05d) file = sled-agent/src/probe_manager.rs:231 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
5872024-11-16T00:44:57.416ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5882024-11-16T00:44:57.416ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b3e7398e-9645-46d0-a57a-4bd06e1408a3/crucible" } file = sled-storage/src/manager.rs:1331
5892024-11-16T00:44:57.508ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5902024-11-16T00:44:57.508ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crypt/zone/oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a"), full_name: "oxp_8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crypt/zone/oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a" } file = sled-storage/src/manager.rs:1331
5912024-11-16T00:44:57.610ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5922024-11-16T00:44:57.610ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_220cf814-be1b-400b-bb43-5ab45b7eb044/crucible" } file = sled-storage/src/manager.rs:1331
5932024-11-16T00:44:57.699ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5942024-11-16T00:44:57.699ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eb288506-11eb-4ffc-bf84-f6c1550028b7/crypt/zone/oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d"), full_name: "oxp_eb288506-11eb-4ffc-bf84-f6c1550028b7/crypt/zone/oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d" } file = sled-storage/src/manager.rs:1331
5952024-11-16T00:44:57.795ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5962024-11-16T00:44:57.795ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad26846d-9efb-4f49-8d19-f73f5a25617e/crypt/debug"), full_name: "oxp_ad26846d-9efb-4f49-8d19-f73f5a25617e/crypt/debug" } file = sled-storage/src/manager.rs:1331
5972024-11-16T00:44:57.864ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5982024-11-16T00:44:57.864ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d49e8c8c-eb53-43b6-a176-aee4725796df/crucible" } file = sled-storage/src/manager.rs:1331
5992024-11-16T00:44:57.956ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
6002024-11-16T00:44:57.956ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
6012024-11-16T00:44:57.958ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6022024-11-16T00:44:57.958ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/769d1181-4cb2-4e0f-87be-d1b20a8a9c58/crypt/debug"), full_name: "oxp_769d1181-4cb2-4e0f-87be-d1b20a8a9c58/crypt/debug" } file = sled-storage/src/manager.rs:1331
6032024-11-16T00:44:57.963ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
6042024-11-16T00:44:57.963ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
6052024-11-16T00:44:58.041ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6062024-11-16T00:44:58.041ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_eb288506-11eb-4ffc-bf84-f6c1550028b7/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
6072024-11-16T00:44:58.045ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12630120938522060802 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
6082024-11-16T00:44:58.045ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6034881668682788223 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
6092024-11-16T00:44:58.110ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
6102024-11-16T00:44:58.110ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
6112024-11-16T00:44:58.142ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6122024-11-16T00:44:58.145ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6132024-11-16T00:44:58.146ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:852 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
6142024-11-16T00:44:58.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5869919 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36974 req_id = 01bede15-c513-4799-b068-6486b55e36fd response_code = 200 uri = /datasets
6152024-11-16T00:44:58.151ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
6162024-11-16T00:44:58.151ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
6172024-11-16T00:44:58.193ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a (service), filesystem_pool: Some(ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee (service), filesystem_pool: Some(ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: c80113c0-af97-4ad7-b95e-0b8746569679 (service), filesystem_pool: Some(ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
6182024-11-16T00:44:58.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44992
6192024-11-16T00:44:58.193ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6202024-11-16T00:44:58.193ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: InternalDns }, responder: ... }
6212024-11-16T00:44:58.196ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
6222024-11-16T00:44:58.196ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
6232024-11-16T00:44:58.217ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
6242024-11-16T00:44:58.217ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
6252024-11-16T00:44:58.228ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee, dataset_name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6262024-11-16T00:44:58.228ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee, dataset_name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: InternalDns }, responder: ... }
6272024-11-16T00:44:58.263ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c80113c0-af97-4ad7-b95e-0b8746569679, dataset_name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6282024-11-16T00:44:58.263ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c80113c0-af97-4ad7-b95e-0b8746569679, dataset_name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6292024-11-16T00:44:58.284ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
6302024-11-16T00:44:58.284ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
6312024-11-16T00:44:58.298ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6322024-11-16T00:44:58.298ZINFOSledAgent (ServiceManager): No ledger in /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/omicron-zones.json file = common/src/ledger.rs:188
6332024-11-16T00:44:58.298ZINFOSledAgent (ServiceManager): No ledger in /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/omicron-zones.json file = common/src/ledger.rs:188
6342024-11-16T00:44:58.298ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6352024-11-16T00:44:58.337ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ad7c66bd-0d53-43e9-89e8-86e0651ea05d) file = sled-agent/src/probe_manager.rs:231 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
6362024-11-16T00:44:58.349ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6372024-11-16T00:44:58.349ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6382024-11-16T00:44:58.349ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6392024-11-16T00:44:58.384ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
6402024-11-16T00:44:58.384ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6412024-11-16T00:44:58.409ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679 file = illumos-utils/src/zone.rs:325
6422024-11-16T00:44:58.413ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a file = illumos-utils/src/zone.rs:325
6432024-11-16T00:44:58.417ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee file = illumos-utils/src/zone.rs:325
6442024-11-16T00:44:58.429ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679 file = illumos-utils/src/zone.rs:363
6452024-11-16T00:44:58.433ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a file = illumos-utils/src/zone.rs:363
6462024-11-16T00:44:58.438ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee file = illumos-utils/src/zone.rs:363
6472024-11-16T00:44:58.446ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:418
6482024-11-16T00:44:58.446ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/ad7c66bd-0d53-43e9-89e8-86e0651ea05d) file = sled-agent/src/nexus.rs:527 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
6492024-11-16T00:44:58.478ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:686
6502024-11-16T00:44:58.478ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:731
6512024-11-16T00:44:58.478ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:734 uptime = 1
6522024-11-16T00:44:58.478ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:440
6532024-11-16T00:44:58.517ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
6542024-11-16T00:44:58.582ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6552024-11-16T00:44:58.582ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6562024-11-16T00:44:58.582ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6572024-11-16T00:44:58.582ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6582024-11-16T00:44:58.582ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6592024-11-16T00:44:58.582ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6602024-11-16T00:44:58.582ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6612024-11-16T00:44:58.582ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6622024-11-16T00:44:58.582ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6632024-11-16T00:44:58.582ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6642024-11-16T00:44:58.582ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6652024-11-16T00:44:58.582ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6662024-11-16T00:44:58.582ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6672024-11-16T00:44:58.582ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6682024-11-16T00:44:58.582ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6692024-11-16T00:44:58.582ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6702024-11-16T00:44:58.582ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6712024-11-16T00:44:58.582ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6722024-11-16T00:44:58.582ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6732024-11-16T00:44:58.582ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6742024-11-16T00:44:58.582ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6752024-11-16T00:44:58.582ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6762024-11-16T00:44:58.582ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6772024-11-16T00:44:59.005ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4760110679328225252 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
6782024-11-16T00:44:59.005ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15204801460447072895 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
6792024-11-16T00:44:59.338ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ad7c66bd-0d53-43e9-89e8-86e0651ea05d) file = sled-agent/src/probe_manager.rs:231 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
6802024-11-16T00:44:59.991ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6812024-11-16T00:45:00.470ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6822024-11-16T00:45:00.470ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6832024-11-16T00:45:00.949ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6842024-11-16T00:45:00.949ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6852024-11-16T00:45:00.949ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6862024-11-16T00:45:00.949ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679
6872024-11-16T00:45:00.954ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a
6882024-11-16T00:45:00.958ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee
6892024-11-16T00:45:01.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679") failed: Property not found. retry in 47.269137ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679
6902024-11-16T00:45:01.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a") failed: Property not found. retry in 30.899931ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a
6912024-11-16T00:45:01.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee") failed: Property not found. retry in 39.120187ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee
6922024-11-16T00:45:01.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a") failed: Property not found. retry in 125.924683ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a
6932024-11-16T00:45:01.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679") failed: Property not found. retry in 57.972352ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679
6942024-11-16T00:45:01.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee") failed: Property not found. retry in 72.760627ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee
6952024-11-16T00:45:01.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679") failed: Property not found. retry in 269.744625ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679
6962024-11-16T00:45:01.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee") failed: Property not found. retry in 210.601855ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee
6972024-11-16T00:45:01.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a") failed: Property not found. retry in 252.257564ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a
6982024-11-16T00:45:01.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee") failed: Property not found. retry in 288.074113ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee
6992024-11-16T00:45:01.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679") failed: Property not found. retry in 315.252047ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679
7002024-11-16T00:45:01.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a") failed: Property not found. retry in 263.265382ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a
7012024-11-16T00:45:01.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee") failed: Property not found. retry in 752.825325ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee
7022024-11-16T00:45:01.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a") failed: Property not found. retry in 587.95591ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a
7032024-11-16T00:45:01.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679") failed: Property not found. retry in 737.321626ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679
7042024-11-16T00:45:02.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a") failed: Property not found. retry in 556.200199ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a
7052024-11-16T00:45:02.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee") failed: Property not found. retry in 712.035697ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee
7062024-11-16T00:45:02.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679") failed: Property not found. retry in 1.39811366s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679
7072024-11-16T00:45:02.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a") failed: Property not found. retry in 728.917961ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a
7082024-11-16T00:45:03.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee") failed: Property not found. retry in 1.47793268s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee
7092024-11-16T00:45:03.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a") failed: Property not found. retry in 933.69325ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a
7102024-11-16T00:45:04.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679") failed: Property not found. retry in 1.317560913s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679
7112024-11-16T00:45:04.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a") failed: Property not found. retry in 1.36988919s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a
7122024-11-16T00:45:04.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee") failed: Property not found. retry in 1.241623753s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee
7132024-11-16T00:45:05.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679") failed: Property not found. retry in 1.018661625s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679
7142024-11-16T00:45:06.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee") failed: Property not found. retry in 676.590224ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee
7152024-11-16T00:45:06.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a") failed: Property not found. retry in 1.38533012s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a
7162024-11-16T00:45:06.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679") failed: Property not found. retry in 535.168169ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679
7172024-11-16T00:45:07.452ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_c80113c0-af97-4ad7-b95e-0b8746569679
7182024-11-16T00:45:07.452ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a
7192024-11-16T00:45:07.452ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee
7202024-11-16T00:45:07.452ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7212024-11-16T00:45:07.452ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7222024-11-16T00:45:07.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9259515 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44992 req_id = 93c5119c-cae2-46e4-aa32-93498f5326ac response_code = 204 uri = /omicron-zones
7232024-11-16T00:45:07.454ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7242024-11-16T00:45:07.536ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 107.196053ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:675
7252024-11-16T00:45:07.663ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7262024-11-16T00:45:07.712ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7272024-11-16T00:45:07.761ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:691
7282024-11-16T00:45:07.761ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7292024-11-16T00:45:07.793ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7302024-11-16T00:45:07.795ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7312024-11-16T00:45:07.795ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7322024-11-16T00:45:07.825ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a (service), filesystem_pool: Some(ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee (service), filesystem_pool: Some(ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: c80113c0-af97-4ad7-b95e-0b8746569679 (service), filesystem_pool: Some(ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 7522ebd4-79c3-43fb-84a7-8466237029e2 (service), filesystem_pool: Some(ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: eb8dcf27-f806-46cd-b7de-c1cc3184466d, kind: Service { id: 7522ebd4-79c3-43fb-84a7-8466237029e2 }, name: Name("ntp-7522ebd4-79c3-43fb-84a7-8466237029e2"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 184])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
7332024-11-16T00:45:07.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49706
7342024-11-16T00:45:07.825ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7352024-11-16T00:45:07.825ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: InternalDns }, responder: ... }
7362024-11-16T00:45:07.861ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee, dataset_name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7372024-11-16T00:45:07.861ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee, dataset_name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: InternalDns }, responder: ... }
7382024-11-16T00:45:07.894ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c80113c0-af97-4ad7-b95e-0b8746569679, dataset_name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7392024-11-16T00:45:07.894ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c80113c0-af97-4ad7-b95e-0b8746569679, dataset_name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7402024-11-16T00:45:07.927ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7412024-11-16T00:45:07.927ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/omicron-zones.json file = common/src/ledger.rs:177
7422024-11-16T00:45:07.927ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/omicron-zones.json file = common/src/ledger.rs:177
7432024-11-16T00:45:07.928ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7442024-11-16T00:45:07.939ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7452024-11-16T00:45:07.971ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7462024-11-16T00:45:07.972ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7472024-11-16T00:45:07.972ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7482024-11-16T00:45:08.001ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 173, 184]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7492024-11-16T00:45:08.001ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7502024-11-16T00:45:08.002ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7512024-11-16T00:45:08.002ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7522024-11-16T00:45:08.002ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7532024-11-16T00:45:08.003ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7542024-11-16T00:45:08.026ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2 file = illumos-utils/src/zone.rs:325
7552024-11-16T00:45:08.043ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2 file = illumos-utils/src/zone.rs:363
7562024-11-16T00:45:08.049ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12630120938522060802 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
7572024-11-16T00:45:08.049ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6034881668682788223 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
7582024-11-16T00:45:08.659ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7592024-11-16T00:45:08.660ZINFOSledAgent (ServiceManager): Booting oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2
7602024-11-16T00:45:08.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2") failed: Property not found. retry in 25.115096ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2
7612024-11-16T00:45:08.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2") failed: Property not found. retry in 126.579172ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2
7622024-11-16T00:45:08.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2") failed: Property not found. retry in 260.975597ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2
7632024-11-16T00:45:09.008ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4760110679328225252 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
7642024-11-16T00:45:09.008ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15204801460447072895 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
7652024-11-16T00:45:09.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2") failed: Property not found. retry in 330.04637ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2
7662024-11-16T00:45:09.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2") failed: Property not found. retry in 880.387903ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2
7672024-11-16T00:45:10.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2") failed: Property not found. retry in 1.010249508s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2
7682024-11-16T00:45:11.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2") failed: Property not found. retry in 983.389016ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2
7692024-11-16T00:45:12.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2") failed: Property not found. retry in 703.152917ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2
7702024-11-16T00:45:13.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2") failed: Property not found. retry in 1.419431541s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2
7712024-11-16T00:45:14.633ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2
7722024-11-16T00:45:14.633ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7732024-11-16T00:45:14.633ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7742024-11-16T00:45:14.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6808281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:49706 req_id = 0b920938-c7d4-459a-812b-ca7581852010 response_code = 204 uri = /omicron-zones
7752024-11-16T00:45:14.636ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:732
7762024-11-16T00:45:14.665ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7772024-11-16T00:45:14.666ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45211
7782024-11-16T00:45:14.673ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7792024-11-16T00:45:14.674ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 7791 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45211 req_id = 18f5e56f-5cff-46ac-8b00-7e97f242e0bf response_code = 500 uri = /timesync
7802024-11-16T00:45:14.676ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7812024-11-16T00:45:14.851ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7822024-11-16T00:45:14.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42051
7832024-11-16T00:45:16.728ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4990826656528106509 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
7842024-11-16T00:45:16.919ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1410940511055074750 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
7852024-11-16T00:45:17.455ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2503978415623621070 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
7862024-11-16T00:45:18.050ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12630120938522060802 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
7872024-11-16T00:45:18.050ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6034881668682788223 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
7882024-11-16T00:45:18.860ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7892024-11-16T00:45:18.860ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008649 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42051 req_id = 0b53e321-d550-46c8-9574-689c35ef5106 response_code = 500 uri = /timesync
7902024-11-16T00:45:18.862ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7912024-11-16T00:45:19.024ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7922024-11-16T00:45:19.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44033
7932024-11-16T00:45:19.028ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4760110679328225252 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
7942024-11-16T00:45:19.028ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15204801460447072895 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
7952024-11-16T00:45:19.032ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7962024-11-16T00:45:19.032ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8540 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44033 req_id = 8bbb2920-6849-44ff-a75e-d41a49dab12a response_code = 500 uri = /timesync
7972024-11-16T00:45:19.034ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7982024-11-16T00:45:19.210ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7992024-11-16T00:45:19.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46769
8002024-11-16T00:45:23.045ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_7522ebd4-79c3-43fb-84a7-8466237029e2': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
8012024-11-16T00:45:23.045ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008772 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46769 req_id = d4e096f6-988e-4fe2-add7-238454b5b9dd response_code = 500 uri = /timesync
8022024-11-16T00:45:23.049ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8032024-11-16T00:45:23.290ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8042024-11-16T00:45:23.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36105
8052024-11-16T00:45:23.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9059 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36105 req_id = 3e7e8ace-c354-4df5-bc10-388fa340497c response_code = 200 uri = /timesync
8062024-11-16T00:45:23.301ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.028939234 } file = sled-agent/src/rack_setup/service.rs:740
8072024-11-16T00:45:23.301ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8082024-11-16T00:45:23.558ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8092024-11-16T00:45:23.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57844
8102024-11-16T00:45:23.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57844 req_id = cb5ef53b-7666-486f-8c66-31f5eb7485fa response_code = 200 uri = /timesync
8112024-11-16T00:45:23.568ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.028211389 } file = sled-agent/src/rack_setup/service.rs:740
8122024-11-16T00:45:23.568ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8132024-11-16T00:45:23.849ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8142024-11-16T00:45:23.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56346
8152024-11-16T00:45:23.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8477 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56346 req_id = 8f92d342-c74c-4e22-869a-047e419d18db response_code = 200 uri = /timesync
8162024-11-16T00:45:23.859ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.027422404 } file = sled-agent/src/rack_setup/service.rs:740
8172024-11-16T00:45:23.859ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8182024-11-16T00:45:24.306ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8192024-11-16T00:45:24.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56248
8202024-11-16T00:45:24.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8685 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56248 req_id = e8040918-2f7e-461e-a5bf-349f7d77c27a response_code = 200 uri = /timesync
8212024-11-16T00:45:24.317ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731717922.6742282, correction: -0.026563821 } file = sled-agent/src/rack_setup/service.rs:740
8222024-11-16T00:45:24.317ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8232024-11-16T00:45:24.458ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16453640306743249922 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
8242024-11-16T00:45:24.459ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8468034665728253499 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
8252024-11-16T00:45:24.540ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8262024-11-16T00:45:24.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51763
8272024-11-16T00:45:24.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8969 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51763 req_id = a7f4f7c3-4956-4af2-a212-d8f34ccb3ab8 response_code = 200 uri = /timesync
8282024-11-16T00:45:24.551ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731717922.6742282, correction: -0.025927842 } file = sled-agent/src/rack_setup/service.rs:740
8292024-11-16T00:45:24.551ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8302024-11-16T00:45:24.800ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8312024-11-16T00:45:24.800ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35939
8322024-11-16T00:45:24.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35939 req_id = 1507eedf-ed68-4312-9f15-8a322701ba40 response_code = 200 uri = /timesync
8332024-11-16T00:45:24.811ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731717922.6742282, correction: -0.025224075 } file = sled-agent/src/rack_setup/service.rs:740
8342024-11-16T00:45:24.811ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8352024-11-16T00:45:25.525ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8362024-11-16T00:45:25.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63565
8372024-11-16T00:45:25.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8941 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63565 req_id = 815646ae-918a-4f4c-921a-b4cae9870672 response_code = 200 uri = /timesync
8382024-11-16T00:45:25.538ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731717922.6742282, correction: -0.023209419 } file = sled-agent/src/rack_setup/service.rs:740
8392024-11-16T00:45:25.538ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8402024-11-16T00:45:26.420ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8412024-11-16T00:45:26.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40006
8422024-11-16T00:45:26.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8540 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40006 req_id = 9fcbcc80-3baf-4e5e-849d-745c9a34549a response_code = 200 uri = /timesync
8432024-11-16T00:45:26.433ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731717922.6742282, correction: -0.020894118 } file = sled-agent/src/rack_setup/service.rs:740
8442024-11-16T00:45:26.433ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8452024-11-16T00:45:26.529ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 211.778476ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
8462024-11-16T00:45:26.548ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4990826656528106509 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
8472024-11-16T00:45:26.738ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1410940511055074750 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
8482024-11-16T00:45:26.930ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8492024-11-16T00:45:26.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39592
8502024-11-16T00:45:26.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8326 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39592 req_id = cba742b0-2e88-4474-9865-9b4a2dd22a9c response_code = 200 uri = /timesync
8512024-11-16T00:45:26.940ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731717922.6742282, correction: -0.019510329 } file = sled-agent/src/rack_setup/service.rs:740
8522024-11-16T00:45:26.941ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8532024-11-16T00:45:27.272ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2503978415623621070 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
8542024-11-16T00:45:27.688ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8552024-11-16T00:45:27.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62928
8562024-11-16T00:45:27.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62928 req_id = 43e26b7b-bd4d-43d3-afe4-fbe8c9ef44af response_code = 200 uri = /timesync
8572024-11-16T00:45:27.697ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731717922.6742282, correction: -0.017152064 } file = sled-agent/src/rack_setup/service.rs:740
8582024-11-16T00:45:27.697ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8592024-11-16T00:45:27.866ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12630120938522060802 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
8602024-11-16T00:45:27.867ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6034881668682788223 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
8612024-11-16T00:45:27.981ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64753
8622024-11-16T00:45:27.982ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64753 req_id = 6146c5bc-a87d-4328-a6bd-f134232b2b64 response_code = 200 uri = /baseboard
8632024-11-16T00:45:28.497ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8642024-11-16T00:45:28.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54339
8652024-11-16T00:45:28.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21324 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54339 req_id = f9b75d1d-63db-4bfb-9a11-d40971308606 response_code = 200 uri = /timesync
8662024-11-16T00:45:28.523ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 3330918944, ip_addr: 198.137.202.32, stratum: 3, ref_time: 1731717927.8453465, correction: -0.014647868 } file = sled-agent/src/rack_setup/service.rs:740
8672024-11-16T00:45:28.523ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1425
8682024-11-16T00:45:28.553ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a (service), filesystem_pool: Some(ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee (service), filesystem_pool: Some(ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: c80113c0-af97-4ad7-b95e-0b8746569679 (service), filesystem_pool: Some(ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 7522ebd4-79c3-43fb-84a7-8466237029e2 (service), filesystem_pool: Some(ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: eb8dcf27-f806-46cd-b7de-c1cc3184466d, kind: Service { id: 7522ebd4-79c3-43fb-84a7-8466237029e2 }, name: Name("ntp-7522ebd4-79c3-43fb-84a7-8466237029e2"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 184])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 3a49b4ec-be24-47ef-aad1-52046604f5b3 (service), filesystem_pool: Some(ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External } } } }, OmicronZoneConfig { id: b6fa57b2-8ac8-4ca5-802e-862f12d8173a (service), filesystem_pool: Some(ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External } } } }, OmicronZoneConfig { id: f64acdd3-0f86-45a4-91b1-39993a4e588a (service), filesystem_pool: Some(ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External } } } }, OmicronZoneConfig { id: 48f72391-076a-4131-b4e5-1cdf907e700b (service), filesystem_pool: Some(ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External } } } }, OmicronZoneConfig { id: f7603929-2d6e-48ef-8f9a-87b66f1f2a6b (service), filesystem_pool: Some(ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
8692024-11-16T00:45:28.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59101
8702024-11-16T00:45:28.553ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8712024-11-16T00:45:28.553ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: InternalDns }, responder: ... }
8722024-11-16T00:45:28.588ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee, dataset_name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8732024-11-16T00:45:28.588ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee, dataset_name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: InternalDns }, responder: ... }
8742024-11-16T00:45:28.619ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c80113c0-af97-4ad7-b95e-0b8746569679, dataset_name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8752024-11-16T00:45:28.619ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c80113c0-af97-4ad7-b95e-0b8746569679, dataset_name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8762024-11-16T00:45:28.650ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3a49b4ec-be24-47ef-aad1-52046604f5b3, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8772024-11-16T00:45:28.650ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3a49b4ec-be24-47ef-aad1-52046604f5b3, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: Cockroach }, responder: ... }
8782024-11-16T00:45:28.682ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b6fa57b2-8ac8-4ca5-802e-862f12d8173a, dataset_name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8792024-11-16T00:45:28.682ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b6fa57b2-8ac8-4ca5-802e-862f12d8173a, dataset_name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: Cockroach }, responder: ... }
8802024-11-16T00:45:28.714ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f64acdd3-0f86-45a4-91b1-39993a4e588a, dataset_name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8812024-11-16T00:45:28.714ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f64acdd3-0f86-45a4-91b1-39993a4e588a, dataset_name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8822024-11-16T00:45:28.745ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 48f72391-076a-4131-b4e5-1cdf907e700b, dataset_name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8832024-11-16T00:45:28.745ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 48f72391-076a-4131-b4e5-1cdf907e700b, dataset_name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8842024-11-16T00:45:28.777ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f7603929-2d6e-48ef-8f9a-87b66f1f2a6b, dataset_name: DatasetName { pool_name: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8852024-11-16T00:45:28.777ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f7603929-2d6e-48ef-8f9a-87b66f1f2a6b, dataset_name: DatasetName { pool_name: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8862024-11-16T00:45:28.809ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8872024-11-16T00:45:28.809ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/omicron-zones.json file = common/src/ledger.rs:177
8882024-11-16T00:45:28.809ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/omicron-zones.json file = common/src/ledger.rs:177
8892024-11-16T00:45:28.809ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8902024-11-16T00:45:28.888ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8912024-11-16T00:45:28.889ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8922024-11-16T00:45:28.889ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8932024-11-16T00:45:28.889ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8942024-11-16T00:45:28.889ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8952024-11-16T00:45:28.981ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3 file = illumos-utils/src/zone.rs:325
8962024-11-16T00:45:28.986ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a file = illumos-utils/src/zone.rs:325
8972024-11-16T00:45:28.990ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a file = illumos-utils/src/zone.rs:325
8982024-11-16T00:45:28.994ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b file = illumos-utils/src/zone.rs:325
8992024-11-16T00:45:28.999ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b file = illumos-utils/src/zone.rs:325
9002024-11-16T00:45:29.004ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3 file = illumos-utils/src/zone.rs:363
9012024-11-16T00:45:29.008ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a file = illumos-utils/src/zone.rs:363
9022024-11-16T00:45:29.013ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a file = illumos-utils/src/zone.rs:363
9032024-11-16T00:45:29.017ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b file = illumos-utils/src/zone.rs:363
9042024-11-16T00:45:29.022ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b file = illumos-utils/src/zone.rs:363
9052024-11-16T00:45:31.893ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='48f72391-076a-4131-b4e5-1cdf907e700b'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9062024-11-16T00:45:31.893ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='3a49b4ec-be24-47ef-aad1-52046604f5b3'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9072024-11-16T00:45:31.893ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b
9082024-11-16T00:45:31.899ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3
9092024-11-16T00:45:31.952ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b6fa57b2-8ac8-4ca5-802e-862f12d8173a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9102024-11-16T00:45:31.952ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a
9112024-11-16T00:45:31.961ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='f7603929-2d6e-48ef-8f9a-87b66f1f2a6b'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9122024-11-16T00:45:31.962ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='f64acdd3-0f86-45a4-91b1-39993a4e588a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9132024-11-16T00:45:31.962ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b
9142024-11-16T00:45:31.966ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a
9152024-11-16T00:45:32.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b") failed: Property not found. retry in 66.272263ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b
9162024-11-16T00:45:32.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3") failed: Property not found. retry in 27.55702ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3
9172024-11-16T00:45:32.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3") failed: Property not found. retry in 110.158002ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3
9182024-11-16T00:45:32.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a") failed: Property not found. retry in 62.56664ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a
9192024-11-16T00:45:32.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b") failed: Property not found. retry in 54.486849ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b
9202024-11-16T00:45:32.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a") failed: Property not found. retry in 45.877924ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a
9212024-11-16T00:45:33.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b") failed: Property not found. retry in 120.614871ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b
9222024-11-16T00:45:33.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3") failed: Property not found. retry in 107.293356ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3
9232024-11-16T00:45:33.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a") failed: Property not found. retry in 121.530357ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a
9242024-11-16T00:45:33.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a") failed: Property not found. retry in 67.25748ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a
9252024-11-16T00:45:34.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b") failed: Property not found. retry in 146.991401ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b
9262024-11-16T00:45:34.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b") failed: Property not found. retry in 86.134731ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b
9272024-11-16T00:45:34.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3") failed: Property not found. retry in 499.817002ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3
9282024-11-16T00:45:34.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a") failed: Property not found. retry in 211.805878ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a
9292024-11-16T00:45:34.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a") failed: Property not found. retry in 103.749932ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a
9302024-11-16T00:45:34.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b") failed: Property not found. retry in 253.185451ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b
9312024-11-16T00:45:34.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b") failed: Property not found. retry in 298.760547ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b
9322024-11-16T00:45:34.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a") failed: Property not found. retry in 476.892649ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a
9332024-11-16T00:45:34.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a") failed: Property not found. retry in 336.886275ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a
9342024-11-16T00:45:34.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b") failed: Property not found. retry in 468.340205ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b
9352024-11-16T00:45:35.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b") failed: Property not found. retry in 399.319963ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b
9362024-11-16T00:45:35.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3") failed: Property not found. retry in 877.306623ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3
9372024-11-16T00:45:35.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a") failed: Property not found. retry in 899.684029ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a
9382024-11-16T00:45:35.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a") failed: Property not found. retry in 773.515072ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a
9392024-11-16T00:45:35.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b") failed: Property not found. retry in 730.277115ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b
9402024-11-16T00:45:35.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b") failed: Property not found. retry in 1.129887728s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b
9412024-11-16T00:45:35.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3") failed: Property not found. retry in 831.957233ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3
9422024-11-16T00:45:36.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a") failed: Property not found. retry in 810.062951ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a
9432024-11-16T00:45:36.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a") failed: Property not found. retry in 1.229577545s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a
9442024-11-16T00:45:36.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b") failed: Property not found. retry in 781.280839ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b
9452024-11-16T00:45:36.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b") failed: Property not found. retry in 525.102767ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b
9462024-11-16T00:45:36.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3") failed: Property not found. retry in 712.852012ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3
9472024-11-16T00:45:36.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a") failed: Property not found. retry in 523.723346ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a
9482024-11-16T00:45:36.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b") failed: Property not found. retry in 601.136498ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b
9492024-11-16T00:45:37.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b") failed: Property not found. retry in 913.362683ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b
9502024-11-16T00:45:37.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a") failed: Property not found. retry in 1.049233847s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a
9512024-11-16T00:45:37.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a") failed: Property not found. retry in 1.22801165s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a
9522024-11-16T00:45:37.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3") failed: Property not found. retry in 652.128675ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3
9532024-11-16T00:45:37.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b") failed: Property not found. retry in 1.02136239s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b
9542024-11-16T00:45:38.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b") failed: Property not found. retry in 942.46839ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b
9552024-11-16T00:45:38.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3") failed: Property not found. retry in 726.222421ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3
9562024-11-16T00:45:38.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a") failed: Property not found. retry in 657.991503ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a
9572024-11-16T00:45:38.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b") failed: Property not found. retry in 1.064321711s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b
9582024-11-16T00:45:38.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a") failed: Property not found. retry in 916.078519ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a
9592024-11-16T00:45:38.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3") failed: Property not found. retry in 720.054312ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3
9602024-11-16T00:45:39.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b") failed: Property not found. retry in 746.280672ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b
9612024-11-16T00:45:39.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a") failed: Property not found. retry in 1.293614601s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a
9622024-11-16T00:45:39.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a") failed: Property not found. retry in 938.887775ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a
9632024-11-16T00:45:39.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3") failed: Property not found. retry in 1.458991336s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3
9642024-11-16T00:45:39.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b") failed: Property not found. retry in 930.503837ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b
9652024-11-16T00:45:39.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b") failed: Property not found. retry in 1.155673834s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b
9662024-11-16T00:45:40.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a") failed: Property not found. retry in 543.615018ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a
9672024-11-16T00:45:40.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a") failed: Property not found. retry in 1.189294559s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a
9682024-11-16T00:45:40.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b") failed: Property not found. retry in 1.325295393s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b
9692024-11-16T00:45:40.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a") failed: Property not found. retry in 579.313572ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a
9702024-11-16T00:45:40.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b") failed: Property not found. retry in 1.147555281s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b
9712024-11-16T00:45:41.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3") failed: Property not found. retry in 1.368929645s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3
9722024-11-16T00:45:41.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a") failed: Property not found. retry in 605.338945ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a
9732024-11-16T00:45:41.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a") failed: Property not found. retry in 1.301090136s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a
9742024-11-16T00:45:41.754ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 400.877023ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
9752024-11-16T00:45:41.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b") failed: Property not found. retry in 1.068196654s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b
9762024-11-16T00:45:42.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b") failed: Property not found. retry in 612.890622ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b
9772024-11-16T00:45:42.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a") failed: Property not found. retry in 870.462314ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a
9782024-11-16T00:45:42.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3") failed: Property not found. retry in 1.437686693s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3
9792024-11-16T00:45:42.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b") failed: Property not found. retry in 1.468821984s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b
9802024-11-16T00:45:43.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a") failed: Property not found. retry in 1.459330131s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a
9812024-11-16T00:45:43.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a") failed: Property not found. retry in 873.276153ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a
9822024-11-16T00:45:43.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b") failed: Property not found. retry in 1.34647417s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b
9832024-11-16T00:45:43.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a") failed: Property not found. retry in 1.117190217s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a
9842024-11-16T00:45:43.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3") failed: Property not found. retry in 927.718744ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3
9852024-11-16T00:45:44.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b") failed: Property not found. retry in 753.156498ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b
9862024-11-16T00:45:44.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b") failed: Property not found. retry in 857.84001ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b
9872024-11-16T00:45:44.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a") failed: Property not found. retry in 522.958337ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a
9882024-11-16T00:45:45.282ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3
9892024-11-16T00:45:45.282ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_f64acdd3-0f86-45a4-91b1-39993a4e588a
9902024-11-16T00:45:45.282ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_b6fa57b2-8ac8-4ca5-802e-862f12d8173a
9912024-11-16T00:45:45.282ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_48f72391-076a-4131-b4e5-1cdf907e700b
9922024-11-16T00:45:45.282ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_f7603929-2d6e-48ef-8f9a-87b66f1f2a6b
9932024-11-16T00:45:45.282ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9942024-11-16T00:45:45.283ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9952024-11-16T00:45:45.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16745262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:59101 req_id = 82ac2d38-5d02-428d-87e5-1616843ab5c3 response_code = 204 uri = /omicron-zones
9962024-11-16T00:45:45.318ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64275
9972024-11-16T00:45:45.351ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 33077 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:64275 req_id = 88dbd503-6734-4c93-96dd-fff689bd07ec response_code = 500 uri = /cockroachdb
9982024-11-16T00:45:45.351ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "88dbd503-6734-4c93-96dd-fff689bd07ec", "content-length": "124", "date": "Sat, 16 Nov 2024 00:45:45 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "88dbd503-6734-4c93-96dd-fff689bd07ec" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 69.31176ms
9992024-11-16T00:45:45.450ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27974 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:64275 req_id = 86ee41c2-5e6d-499d-a755-b18df834ca20 response_code = 500 uri = /cockroachdb
10002024-11-16T00:45:45.450ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "86ee41c2-5e6d-499d-a755-b18df834ca20", "content-length": "124", "date": "Sat, 16 Nov 2024 00:45:45 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "86ee41c2-5e6d-499d-a755-b18df834ca20" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 172.146047ms
10012024-11-16T00:45:45.653ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29241 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:64275 req_id = c62fcec5-4cec-4627-a8da-de4dfa8a1959 response_code = 500 uri = /cockroachdb
10022024-11-16T00:45:45.654ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c62fcec5-4cec-4627-a8da-de4dfa8a1959", "content-length": "124", "date": "Sat, 16 Nov 2024 00:45:45 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c62fcec5-4cec-4627-a8da-de4dfa8a1959" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 102.664201ms
10032024-11-16T00:45:45.786ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28529 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:64275 req_id = bf5747d1-ae7a-4d2f-91c6-0ad4c3279c91 response_code = 500 uri = /cockroachdb
10042024-11-16T00:45:45.787ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "bf5747d1-ae7a-4d2f-91c6-0ad4c3279c91", "content-length": "124", "date": "Sat, 16 Nov 2024 00:45:45 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "bf5747d1-ae7a-4d2f-91c6-0ad4c3279c91" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 226.83849ms
10052024-11-16T00:45:46.045ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 30551 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:64275 req_id = 4fde96fb-68d0-437c-8fb4-91b34dcb2fb0 response_code = 500 uri = /cockroachdb
10062024-11-16T00:45:46.046ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4fde96fb-68d0-437c-8fb4-91b34dcb2fb0", "content-length": "124", "date": "Sat, 16 Nov 2024 00:45:45 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4fde96fb-68d0-437c-8fb4-91b34dcb2fb0" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 227.345992ms
10072024-11-16T00:45:46.300ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3a49b4ec-be24-47ef-aad1-52046604f5b3 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26301 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:64275 req_id = aa1018cd-57b5-4e5d-8ce6-15309598fe86 response_code = 500 uri = /cockroachdb
10082024-11-16T00:45:46.301ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "aa1018cd-57b5-4e5d-8ce6-15309598fe86", "content-length": "124", "date": "Sat, 16 Nov 2024 00:45:45 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "aa1018cd-57b5-4e5d-8ce6-15309598fe86" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 321.684833ms
10092024-11-16T00:45:46.652ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:3743
10102024-11-16T00:46:12.561ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
10112024-11-16T00:46:19.633ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
10122024-11-16T00:46:19.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33009244 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:64275 req_id = e03dac63-84c3-4bcb-8c00-42db74051b99 response_code = 204 uri = /cockroachdb
10132024-11-16T00:46:19.635ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49451
10142024-11-16T00:46:19.639ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 545.618424ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
10152024-11-16T00:46:19.670ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a (service), filesystem_pool: Some(ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee (service), filesystem_pool: Some(ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: c80113c0-af97-4ad7-b95e-0b8746569679 (service), filesystem_pool: Some(ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 7522ebd4-79c3-43fb-84a7-8466237029e2 (service), filesystem_pool: Some(ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: eb8dcf27-f806-46cd-b7de-c1cc3184466d, kind: Service { id: 7522ebd4-79c3-43fb-84a7-8466237029e2 }, name: Name("ntp-7522ebd4-79c3-43fb-84a7-8466237029e2"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 184])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 3a49b4ec-be24-47ef-aad1-52046604f5b3 (service), filesystem_pool: Some(ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External } } } }, OmicronZoneConfig { id: b6fa57b2-8ac8-4ca5-802e-862f12d8173a (service), filesystem_pool: Some(ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External } } } }, OmicronZoneConfig { id: f64acdd3-0f86-45a4-91b1-39993a4e588a (service), filesystem_pool: Some(ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External } } } }, OmicronZoneConfig { id: 48f72391-076a-4131-b4e5-1cdf907e700b (service), filesystem_pool: Some(ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External } } } }, OmicronZoneConfig { id: f7603929-2d6e-48ef-8f9a-87b66f1f2a6b (service), filesystem_pool: Some(ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf (service), filesystem_pool: Some(ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 729e6010-0a28-4302-8831-f6612b85a78f, kind: Service { id: 4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf }, name: Name("external-dns-4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888 (service), filesystem_pool: Some(ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 590b90e0-533a-4c8d-9965-a74bed460cd8, kind: Service { id: 3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888 }, name: Name("external-dns-3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 11])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 6d7cf1e6-3ed9-42bc-8f17-49159affac6b (service), filesystem_pool: Some(ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 4c60317e-983a-4ac6-8708-96d944c78888, kind: Service { id: 6d7cf1e6-3ed9-42bc-8f17-49159affac6b }, name: Name("nexus-6d7cf1e6-3ed9-42bc-8f17-49159affac6b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: ff27fc99-a5d9-4c14-972a-fc3b1a67eb96 (service), filesystem_pool: Some(ZpoolName { id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: fa85ba01-9643-4c9d-8080-62de967b5b63, kind: Service { id: ff27fc99-a5d9-4c14-972a-fc3b1a67eb96 }, name: Name("nexus-ff27fc99-a5d9-4c14-972a-fc3b1a67eb96"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 158])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: cebce92a-579a-4295-b410-4ce799c5bf29 (service), filesystem_pool: Some(ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 86c67e2b-8c46-4e16-8253-9de9bc79f0fa, kind: Service { id: cebce92a-579a-4295-b410-4ce799c5bf29 }, name: Name("nexus-cebce92a-579a-4295-b410-4ce799c5bf29"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 44e32ae0-e49c-4d3f-9d58-d04410c9ffa6 (service), filesystem_pool: Some(ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 569788cc-821e-4658-948b-5e5a34a278f1 (service), filesystem_pool: Some(ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External } } } }, OmicronZoneConfig { id: 575b7fa0-5470-497f-a336-37cec1374bc5 (service), filesystem_pool: Some(ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 4c8ef314-c004-428d-a00a-64bc786ac3a6 (service), filesystem_pool: Some(ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 7e8da82b-fd0a-41d9-9320-a043430b9e89 (service), filesystem_pool: Some(ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: aa8ef199-ff13-4bdb-b31a-e6207556abcd (service), filesystem_pool: Some(ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External } } } }, OmicronZoneConfig { id: 0bf20a8b-7bf7-416f-83ed-8569fc9c1490 (service), filesystem_pool: Some(ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External } } } }, OmicronZoneConfig { id: d011d103-e2d3-4e31-99a3-702678d6e86a (service), filesystem_pool: Some(ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8a30a7ac-6c9e-413d-88bb-25f574dec214 (service), filesystem_pool: Some(ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 13730105-f533-4f95-87fb-90f1e57f672d (service), filesystem_pool: Some(ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External } } } }, OmicronZoneConfig { id: b240ea0f-29c5-4b63-8b2b-01e85c8917f3 (service), filesystem_pool: Some(ZpoolName { id: 2df48cc0-997e-4c6b-92f6-f05e369b8ceb (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2df48cc0-997e-4c6b-92f6-f05e369b8ceb (zpool), kind: External } } } }, OmicronZoneConfig { id: a539f104-82d1-43cd-96eb-70a7ebd036e9 (service), filesystem_pool: Some(ZpoolName { id: 769d1181-4cb2-4e0f-87be-d1b20a8a9c58 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 769d1181-4cb2-4e0f-87be-d1b20a8a9c58 (zpool), kind: External } } } }, OmicronZoneConfig { id: 68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36 (service), filesystem_pool: Some(ZpoolName { id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool), kind: External } } } }, OmicronZoneConfig { id: 0b4fb600-f4f3-47ea-b984-9bf63673ff3e (service), filesystem_pool: Some(ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
10162024-11-16T00:46:19.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45275
10172024-11-16T00:46:19.672ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10182024-11-16T00:46:19.672ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 6a6577d2-bb7e-4e5f-b40e-f761cbb3b32a, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: InternalDns }, responder: ... }
10192024-11-16T00:46:19.730ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee, dataset_name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10202024-11-16T00:46:19.730ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: efb58d7c-9eb5-4abc-9450-c5e9bc5bf2ee, dataset_name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: InternalDns }, responder: ... }
10212024-11-16T00:46:19.772ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c80113c0-af97-4ad7-b95e-0b8746569679, dataset_name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10222024-11-16T00:46:19.772ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c80113c0-af97-4ad7-b95e-0b8746569679, dataset_name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10232024-11-16T00:46:19.816ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3a49b4ec-be24-47ef-aad1-52046604f5b3, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10242024-11-16T00:46:19.816ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3a49b4ec-be24-47ef-aad1-52046604f5b3, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: Cockroach }, responder: ... }
10252024-11-16T00:46:19.894ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b6fa57b2-8ac8-4ca5-802e-862f12d8173a, dataset_name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10262024-11-16T00:46:19.894ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b6fa57b2-8ac8-4ca5-802e-862f12d8173a, dataset_name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: Cockroach }, responder: ... }
10272024-11-16T00:46:19.940ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f64acdd3-0f86-45a4-91b1-39993a4e588a, dataset_name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10282024-11-16T00:46:19.940ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f64acdd3-0f86-45a4-91b1-39993a4e588a, dataset_name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10292024-11-16T00:46:19.981ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 48f72391-076a-4131-b4e5-1cdf907e700b, dataset_name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10302024-11-16T00:46:19.981ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 48f72391-076a-4131-b4e5-1cdf907e700b, dataset_name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10312024-11-16T00:46:20.021ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f7603929-2d6e-48ef-8f9a-87b66f1f2a6b, dataset_name: DatasetName { pool_name: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10322024-11-16T00:46:20.021ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f7603929-2d6e-48ef-8f9a-87b66f1f2a6b, dataset_name: DatasetName { pool_name: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10332024-11-16T00:46:20.064ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10342024-11-16T00:46:20.064ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10352024-11-16T00:46:20.105ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888, dataset_name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10362024-11-16T00:46:20.105ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888, dataset_name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10372024-11-16T00:46:20.146ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 569788cc-821e-4658-948b-5e5a34a278f1, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
10382024-11-16T00:46:20.146ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 569788cc-821e-4658-948b-5e5a34a278f1, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10392024-11-16T00:46:20.193ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: aa8ef199-ff13-4bdb-b31a-e6207556abcd, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10402024-11-16T00:46:20.193ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: aa8ef199-ff13-4bdb-b31a-e6207556abcd, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, kind: Crucible }, responder: ... }
10412024-11-16T00:46:20.235ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0bf20a8b-7bf7-416f-83ed-8569fc9c1490, dataset_name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10422024-11-16T00:46:20.235ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0bf20a8b-7bf7-416f-83ed-8569fc9c1490, dataset_name: DatasetName { pool_name: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, kind: Crucible }, responder: ... }
10432024-11-16T00:46:20.279ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d011d103-e2d3-4e31-99a3-702678d6e86a, dataset_name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10442024-11-16T00:46:20.279ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d011d103-e2d3-4e31-99a3-702678d6e86a, dataset_name: DatasetName { pool_name: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, kind: Crucible }, responder: ... }
10452024-11-16T00:46:20.322ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8a30a7ac-6c9e-413d-88bb-25f574dec214, dataset_name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10462024-11-16T00:46:20.322ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 8a30a7ac-6c9e-413d-88bb-25f574dec214, dataset_name: DatasetName { pool_name: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, kind: Crucible }, responder: ... }
10472024-11-16T00:46:20.367ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 13730105-f533-4f95-87fb-90f1e57f672d, dataset_name: DatasetName { pool_name: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10482024-11-16T00:46:20.367ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 13730105-f533-4f95-87fb-90f1e57f672d, dataset_name: DatasetName { pool_name: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }, kind: Crucible }, responder: ... }
10492024-11-16T00:46:20.408ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b240ea0f-29c5-4b63-8b2b-01e85c8917f3, dataset_name: DatasetName { pool_name: ZpoolName { id: 2df48cc0-997e-4c6b-92f6-f05e369b8ceb (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10502024-11-16T00:46:20.408ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b240ea0f-29c5-4b63-8b2b-01e85c8917f3, dataset_name: DatasetName { pool_name: ZpoolName { id: 2df48cc0-997e-4c6b-92f6-f05e369b8ceb (zpool), kind: External }, kind: Crucible }, responder: ... }
10512024-11-16T00:46:20.453ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a539f104-82d1-43cd-96eb-70a7ebd036e9, dataset_name: DatasetName { pool_name: ZpoolName { id: 769d1181-4cb2-4e0f-87be-d1b20a8a9c58 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10522024-11-16T00:46:20.453ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a539f104-82d1-43cd-96eb-70a7ebd036e9, dataset_name: DatasetName { pool_name: ZpoolName { id: 769d1181-4cb2-4e0f-87be-d1b20a8a9c58 (zpool), kind: External }, kind: Crucible }, responder: ... }
10532024-11-16T00:46:20.495ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36, dataset_name: DatasetName { pool_name: ZpoolName { id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10542024-11-16T00:46:20.495ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36, dataset_name: DatasetName { pool_name: ZpoolName { id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool), kind: External }, kind: Crucible }, responder: ... }
10552024-11-16T00:46:20.536ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0b4fb600-f4f3-47ea-b984-9bf63673ff3e, dataset_name: DatasetName { pool_name: ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10562024-11-16T00:46:20.536ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0b4fb600-f4f3-47ea-b984-9bf63673ff3e, dataset_name: DatasetName { pool_name: ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }, kind: Crucible }, responder: ... }
10572024-11-16T00:46:20.577ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10582024-11-16T00:46:20.577ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/omicron-zones.json file = common/src/ledger.rs:177
10592024-11-16T00:46:20.577ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/omicron-zones.json file = common/src/ledger.rs:177
10602024-11-16T00:46:20.577ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10612024-11-16T00:46:20.691ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10622024-11-16T00:46:20.692ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10632024-11-16T00:46:20.692ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10642024-11-16T00:46:20.693ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10652024-11-16T00:46:20.708ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10662024-11-16T00:46:20.708ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10672024-11-16T00:46:20.708ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10682024-11-16T00:46:20.756ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10692024-11-16T00:46:20.756ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10702024-11-16T00:46:20.756ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10712024-11-16T00:46:20.926ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10722024-11-16T00:46:20.926ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10732024-11-16T00:46:20.926ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10742024-11-16T00:46:20.926ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10752024-11-16T00:46:20.926ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10762024-11-16T00:46:20.926ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10772024-11-16T00:46:20.948ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10782024-11-16T00:46:20.948ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10792024-11-16T00:46:20.959ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10802024-11-16T00:46:20.959ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6 file = illumos-utils/src/zone.rs:325
10812024-11-16T00:46:20.964ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1 file = illumos-utils/src/zone.rs:325
10822024-11-16T00:46:20.969ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6 file = illumos-utils/src/zone.rs:325
10832024-11-16T00:46:20.974ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89 file = illumos-utils/src/zone.rs:325
10842024-11-16T00:46:20.979ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd file = illumos-utils/src/zone.rs:325
10852024-11-16T00:46:20.984ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490 file = illumos-utils/src/zone.rs:325
10862024-11-16T00:46:20.988ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a file = illumos-utils/src/zone.rs:325
10872024-11-16T00:46:21.125ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6 file = illumos-utils/src/zone.rs:363
10882024-11-16T00:46:21.130ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1 file = illumos-utils/src/zone.rs:363
10892024-11-16T00:46:21.134ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6 file = illumos-utils/src/zone.rs:363
10902024-11-16T00:46:21.138ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89 file = illumos-utils/src/zone.rs:363
10912024-11-16T00:46:21.143ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd file = illumos-utils/src/zone.rs:363
10922024-11-16T00:46:21.147ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490 file = illumos-utils/src/zone.rs:363
10932024-11-16T00:46:21.151ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a file = illumos-utils/src/zone.rs:363
10942024-11-16T00:46:21.155ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214 file = illumos-utils/src/zone.rs:325
10952024-11-16T00:46:21.160ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d file = illumos-utils/src/zone.rs:325
10962024-11-16T00:46:21.164ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5 file = illumos-utils/src/zone.rs:325
10972024-11-16T00:46:21.169ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9 file = illumos-utils/src/zone.rs:325
10982024-11-16T00:46:21.173ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36 file = illumos-utils/src/zone.rs:325
10992024-11-16T00:46:21.178ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e file = illumos-utils/src/zone.rs:325
11002024-11-16T00:46:21.183ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3 file = illumos-utils/src/zone.rs:325
11012024-11-16T00:46:21.220ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11022024-11-16T00:46:21.221ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214 file = illumos-utils/src/zone.rs:363
11032024-11-16T00:46:21.226ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d file = illumos-utils/src/zone.rs:363
11042024-11-16T00:46:21.231ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5 file = illumos-utils/src/zone.rs:363
11052024-11-16T00:46:21.236ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9 file = illumos-utils/src/zone.rs:363
11062024-11-16T00:46:21.242ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36 file = illumos-utils/src/zone.rs:363
11072024-11-16T00:46:21.248ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e file = illumos-utils/src/zone.rs:363
11082024-11-16T00:46:21.255ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3 file = illumos-utils/src/zone.rs:363
11092024-11-16T00:46:21.320ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11102024-11-16T00:46:21.377ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11112024-11-16T00:46:21.437ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11122024-11-16T00:46:21.497ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11132024-11-16T00:46:21.499ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11142024-11-16T00:46:21.499ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11152024-11-16T00:46:21.562ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 241, 133]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11162024-11-16T00:46:21.562ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11172024-11-16T00:46:21.565ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11182024-11-16T00:46:21.565ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11192024-11-16T00:46:21.618ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 253, 11]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11202024-11-16T00:46:21.618ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11212024-11-16T00:46:21.620ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11222024-11-16T00:46:21.620ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11232024-11-16T00:46:21.672ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 253, 83]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11242024-11-16T00:46:21.672ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11252024-11-16T00:46:21.674ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11262024-11-16T00:46:21.674ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11272024-11-16T00:46:21.726ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 250, 60]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11282024-11-16T00:46:21.726ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11292024-11-16T00:46:21.729ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
11302024-11-16T00:46:21.729ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
11312024-11-16T00:46:21.730ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11322024-11-16T00:46:21.730ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11332024-11-16T00:46:21.784ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 196, 158]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11342024-11-16T00:46:21.784ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11352024-11-16T00:46:21.784ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
11362024-11-16T00:46:21.786ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11372024-11-16T00:46:21.833ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
11382024-11-16T00:46:21.833ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
11392024-11-16T00:46:21.833ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
11402024-11-16T00:46:21.833ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
11412024-11-16T00:46:21.833ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
11422024-11-16T00:46:21.833ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
11432024-11-16T00:46:21.833ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
11442024-11-16T00:46:21.833ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
11452024-11-16T00:46:21.834ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
11462024-11-16T00:46:21.837ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
11472024-11-16T00:46:21.841ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
11482024-11-16T00:46:21.841ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11492024-11-16T00:46:21.841ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11502024-11-16T00:46:21.845ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11512024-11-16T00:46:21.845ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
11522024-11-16T00:46:22.006ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11532024-11-16T00:46:22.006ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b file = illumos-utils/src/zone.rs:325
11542024-11-16T00:46:22.057ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888 file = illumos-utils/src/zone.rs:325
11552024-11-16T00:46:22.065ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29 file = illumos-utils/src/zone.rs:325
11562024-11-16T00:46:22.077ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf file = illumos-utils/src/zone.rs:325
11572024-11-16T00:46:22.103ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b file = illumos-utils/src/zone.rs:363
11582024-11-16T00:46:22.128ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96 file = illumos-utils/src/zone.rs:325
11592024-11-16T00:46:22.143ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888 file = illumos-utils/src/zone.rs:363
11602024-11-16T00:46:22.153ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29 file = illumos-utils/src/zone.rs:363
11612024-11-16T00:46:22.168ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf file = illumos-utils/src/zone.rs:363
11622024-11-16T00:46:22.186ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96 file = illumos-utils/src/zone.rs:363
11632024-11-16T00:46:25.330ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11642024-11-16T00:46:25.331ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6
11652024-11-16T00:46:25.437ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_769d1181-4cb2-4e0f-87be-d1b20a8a9c58/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1b36e4d4-51b0-46a9-8cd4-307092c35487'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11662024-11-16T00:46:25.437ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ad26846d-9efb-4f49-8d19-f73f5a25617e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='8d4de7d6-4f03-467c-810f-b0f80f68c732'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11672024-11-16T00:46:25.437ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2df48cc0-997e-4c6b-92f6-f05e369b8ceb/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='dac292a6-bf63-4d33-9af6-e388caa07586'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11682024-11-16T00:46:25.437ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9
11692024-11-16T00:46:25.518ZINFOSledAgent (ServiceManager): Booting oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36
11702024-11-16T00:46:25.538ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_96d0d34c-625d-45e2-b0db-1fbc7541f944/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='71c9e418-3ffd-4d4b-9176-652163dd4097'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11712024-11-16T00:46:25.538ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
11722024-11-16T00:46:25.557ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_220cf814-be1b-400b-bb43-5ab45b7eb044/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='45f6c482-e56c-4b60-92b8-cabb98531da4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11732024-11-16T00:46:25.570ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_eb288506-11eb-4ffc-bf84-f6c1550028b7/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='fa290cf7-85c6-4e30-ac28-5c474920230f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11742024-11-16T00:46:25.571ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e
11752024-11-16T00:46:25.576ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a
11762024-11-16T00:46:25.634ZINFOSledAgent (ServiceManager): Booting oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d
11772024-11-16T00:46:26.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6") failed: Property not found. retry in 54.502892ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6
11782024-11-16T00:46:26.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a") failed: Property not found. retry in 56.267071ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a
11792024-11-16T00:46:26.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d") failed: Property not found. retry in 65.539081ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d
11802024-11-16T00:46:26.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9") failed: Property not found. retry in 59.286783ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9
11812024-11-16T00:46:26.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36") failed: Property not found. retry in 53.634439ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36
11822024-11-16T00:46:27.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e") failed: Property not found. retry in 29.197606ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e
11832024-11-16T00:46:27.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3") failed: Property not found. retry in 30.558639ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
11842024-11-16T00:46:27.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6") failed: Property not found. retry in 98.985367ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6
11852024-11-16T00:46:27.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a") failed: Property not found. retry in 62.127329ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a
11862024-11-16T00:46:27.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d") failed: Property not found. retry in 77.245576ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d
11872024-11-16T00:46:27.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9") failed: Property not found. retry in 145.065335ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9
11882024-11-16T00:46:27.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36") failed: Property not found. retry in 138.767733ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36
11892024-11-16T00:46:27.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e") failed: Property not found. retry in 71.194686ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e
11902024-11-16T00:46:27.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3") failed: Property not found. retry in 62.704734ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
11912024-11-16T00:46:27.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a") failed: Property not found. retry in 172.328087ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a
11922024-11-16T00:46:27.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6") failed: Property not found. retry in 192.567505ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6
11932024-11-16T00:46:27.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d") failed: Property not found. retry in 131.978872ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d
11942024-11-16T00:46:27.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e") failed: Property not found. retry in 162.698768ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e
11952024-11-16T00:46:27.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3") failed: Property not found. retry in 166.581916ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
11962024-11-16T00:46:27.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9") failed: Property not found. retry in 230.87053ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9
11972024-11-16T00:46:27.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36") failed: Property not found. retry in 286.675784ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36
11982024-11-16T00:46:27.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d") failed: Property not found. retry in 304.726383ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d
11992024-11-16T00:46:27.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a") failed: Property not found. retry in 575.16491ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a
12002024-11-16T00:46:27.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6") failed: Property not found. retry in 599.904975ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6
12012024-11-16T00:46:27.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e") failed: Property not found. retry in 574.418877ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e
12022024-11-16T00:46:27.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3") failed: Property not found. retry in 540.378446ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
12032024-11-16T00:46:27.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9") failed: Property not found. retry in 238.041042ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9
12042024-11-16T00:46:27.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36") failed: Property not found. retry in 503.090316ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36
12052024-11-16T00:46:27.875ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12062024-11-16T00:46:27.876ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b66562d5-0efb-405c-9448-5618916a7d9c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12072024-11-16T00:46:27.876ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12082024-11-16T00:46:27.876ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89
12092024-11-16T00:46:27.882ZINFOSledAgent (ServiceManager): Booting oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
12102024-11-16T00:46:27.888ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
12112024-11-16T00:46:27.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d") failed: Property not found. retry in 1.065835728s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d
12122024-11-16T00:46:27.967ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b3e7398e-9645-46d0-a57a-4bd06e1408a3/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='21cb9086-143f-4c5a-9df7-a7f09445a8ef'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12132024-11-16T00:46:27.967ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214
12142024-11-16T00:46:28.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9") failed: Property not found. retry in 737.500583ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9
12152024-11-16T00:46:28.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89") failed: Property not found. retry in 55.942522ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89
12162024-11-16T00:46:28.121ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12172024-11-16T00:46:28.121ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf
12182024-11-16T00:46:28.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5") failed: Property not found. retry in 70.411297ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
12192024-11-16T00:46:28.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd") failed: Property not found. retry in 49.448592ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
12202024-11-16T00:46:28.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89") failed: Property not found. retry in 118.834036ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89
12212024-11-16T00:46:28.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a") failed: Property not found. retry in 947.388049ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a
12222024-11-16T00:46:28.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd") failed: Property not found. retry in 101.727691ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
12232024-11-16T00:46:28.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214") failed: Property not found. retry in 34.415398ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214
12242024-11-16T00:46:28.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5") failed: Property not found. retry in 55.314613ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
12252024-11-16T00:46:28.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3") failed: Property not found. retry in 661.464597ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
12262024-11-16T00:46:28.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6") failed: Property not found. retry in 472.169182ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6
12272024-11-16T00:46:28.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e") failed: Property not found. retry in 880.105862ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e
12282024-11-16T00:46:28.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214") failed: Property not found. retry in 94.405592ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214
12292024-11-16T00:46:28.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89") failed: Property not found. retry in 199.085284ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89
12302024-11-16T00:46:28.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5") failed: Property not found. retry in 228.52051ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
12312024-11-16T00:46:28.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd") failed: Property not found. retry in 267.27071ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
12322024-11-16T00:46:28.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36") failed: Property not found. retry in 993.495767ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36
12332024-11-16T00:46:28.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214") failed: Property not found. retry in 256.532849ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214
12342024-11-16T00:46:28.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89") failed: Property not found. retry in 364.027878ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89
12352024-11-16T00:46:28.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5") failed: Property not found. retry in 582.778233ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
12362024-11-16T00:46:28.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd") failed: Property not found. retry in 467.300762ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
12372024-11-16T00:46:28.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214") failed: Property not found. retry in 594.728586ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214
12382024-11-16T00:46:28.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6") failed: Property not found. retry in 1.354335178s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6
12392024-11-16T00:46:28.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9") failed: Property not found. retry in 1.202491848s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9
12402024-11-16T00:46:28.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89") failed: Property not found. retry in 401.660755ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89
12412024-11-16T00:46:28.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3") failed: Property not found. retry in 773.593467ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
12422024-11-16T00:46:29.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d") failed: Property not found. retry in 867.66684ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d
12432024-11-16T00:46:29.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd") failed: Property not found. retry in 651.759984ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
12442024-11-16T00:46:29.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a") failed: Property not found. retry in 1.340980222s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a
12452024-11-16T00:46:29.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e") failed: Property not found. retry in 850.284447ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e
12462024-11-16T00:46:29.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5") failed: Property not found. retry in 970.609466ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
12472024-11-16T00:46:29.233ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12482024-11-16T00:46:29.234ZINFOSledAgent (ServiceManager): Booting oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96
12492024-11-16T00:46:29.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214") failed: Property not found. retry in 667.773673ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214
12502024-11-16T00:46:29.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89") failed: Property not found. retry in 1.08290849s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89
12512024-11-16T00:46:29.378ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d49e8c8c-eb53-43b6-a176-aee4725796df/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='348f2790-5d2f-4c40-a564-120c2bfd68b2'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12522024-11-16T00:46:29.378ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490
12532024-11-16T00:46:29.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36") failed: Property not found. retry in 1.420073141s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36
12542024-11-16T00:46:29.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96") failed: Property not found. retry in 38.6232ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96
12552024-11-16T00:46:29.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96") failed: Property not found. retry in 118.68005ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96
12562024-11-16T00:46:29.570ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12572024-11-16T00:46:29.570ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888
12582024-11-16T00:46:29.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490") failed: Property not found. retry in 29.013404ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490
12592024-11-16T00:46:29.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490") failed: Property not found. retry in 148.935792ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490
12602024-11-16T00:46:29.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96") failed: Property not found. retry in 294.185724ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96
12612024-11-16T00:46:29.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3") failed: Property not found. retry in 1.266591974s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
12622024-11-16T00:46:29.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490") failed: Property not found. retry in 162.439989ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490
12632024-11-16T00:46:29.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888") failed: Property not found. retry in 47.775455ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888
12642024-11-16T00:46:29.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd") failed: Property not found. retry in 586.931825ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
12652024-11-16T00:46:29.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888") failed: Property not found. retry in 64.004198ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888
12662024-11-16T00:46:29.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d") failed: Property not found. retry in 624.644908ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d
12672024-11-16T00:46:29.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888") failed: Property not found. retry in 291.373277ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888
12682024-11-16T00:46:29.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490") failed: Property not found. retry in 245.233768ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490
12692024-11-16T00:46:30.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96") failed: Property not found. retry in 424.009042ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96
12702024-11-16T00:46:30.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214") failed: Property not found. retry in 839.872978ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214
12712024-11-16T00:46:30.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e") failed: Property not found. retry in 1.446724748s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e
12722024-11-16T00:46:30.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9") failed: Property not found. retry in 658.38016ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9
12732024-11-16T00:46:30.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6") failed: Property not found. retry in 1.043415011s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6
12742024-11-16T00:46:30.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5") failed: Property not found. retry in 1.483753337s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
12752024-11-16T00:46:30.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490") failed: Property not found. retry in 1.034025691s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490
12762024-11-16T00:46:30.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888") failed: Property not found. retry in 553.940902ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888
12772024-11-16T00:46:30.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd") failed: Property not found. retry in 963.970815ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
12782024-11-16T00:46:30.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96") failed: Property not found. retry in 411.315232ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96
12792024-11-16T00:46:30.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89") failed: Property not found. retry in 1.308645706s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89
12802024-11-16T00:46:30.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a") failed: Property not found. retry in 1.447471587s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a
12812024-11-16T00:46:30.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d") failed: Property not found. retry in 643.659859ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d
12822024-11-16T00:46:30.689ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='44e32ae0-e49c-4d3f-9d58-d04410c9ffa6'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12832024-11-16T00:46:30.689ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6
12842024-11-16T00:46:30.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9") failed: Property not found. retry in 541.712043ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9
12852024-11-16T00:46:30.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888") failed: Property not found. retry in 1.186019088s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888
12862024-11-16T00:46:30.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36") failed: Property not found. retry in 1.321836495s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36
12872024-11-16T00:46:30.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96") failed: Property not found. retry in 535.178637ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96
12882024-11-16T00:46:30.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214") failed: Property not found. retry in 1.435292928s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214
12892024-11-16T00:46:30.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6") failed: Property not found. retry in 48.488074ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6
12902024-11-16T00:46:30.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6") failed: Property not found. retry in 106.730286ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6
12912024-11-16T00:46:31.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3") failed: Property not found. retry in 575.291812ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
12922024-11-16T00:46:31.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6") failed: Property not found. retry in 205.65481ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6
12932024-11-16T00:46:31.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d") failed: Property not found. retry in 1.042289246s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d
12942024-11-16T00:46:31.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6") failed: Property not found. retry in 1.467537412s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6
12952024-11-16T00:46:31.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490") failed: Property not found. retry in 1.311982616s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490
12962024-11-16T00:46:31.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9") failed: Property not found. retry in 1.359286355s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9
12972024-11-16T00:46:31.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6") failed: Property not found. retry in 400.944338ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6
12982024-11-16T00:46:31.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd") failed: Property not found. retry in 969.710709ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
12992024-11-16T00:46:31.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96") failed: Property not found. retry in 607.496564ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96
13002024-11-16T00:46:31.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e") failed: Property not found. retry in 1.15234567s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e
13012024-11-16T00:46:31.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3") failed: Property not found. retry in 1.25429742s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
13022024-11-16T00:46:31.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5") failed: Property not found. retry in 1.237515092s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
13032024-11-16T00:46:31.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6") failed: Property not found. retry in 849.800122ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6
13042024-11-16T00:46:31.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89") failed: Property not found. retry in 1.057005514s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89
13052024-11-16T00:46:32.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a") failed: Property not found. retry in 536.155115ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a
13062024-11-16T00:46:32.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888") failed: Property not found. retry in 1.224338735s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888
13072024-11-16T00:46:32.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96") failed: Property not found. retry in 1.007122859s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96
13082024-11-16T00:46:32.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36") failed: Property not found. retry in 1.260926724s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36
13092024-11-16T00:46:32.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d") failed: Property not found. retry in 1.176124497s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d
13102024-11-16T00:46:32.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214") failed: Property not found. retry in 1.153925393s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214
13112024-11-16T00:46:32.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd") failed: Property not found. retry in 869.462602ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
13122024-11-16T00:46:32.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a") failed: Property not found. retry in 529.247657ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a
13132024-11-16T00:46:32.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6") failed: Property not found. retry in 512.611481ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6
13142024-11-16T00:46:32.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490") failed: Property not found. retry in 546.945188ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490
13152024-11-16T00:46:32.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9") failed: Property not found. retry in 1.182579092s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9
13162024-11-16T00:46:32.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e") failed: Property not found. retry in 996.608785ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e
13172024-11-16T00:46:32.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6") failed: Property not found. retry in 1.128198491s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6
13182024-11-16T00:46:32.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf") failed: Property not found. retry in 36.426461ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf
13192024-11-16T00:46:32.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf") failed: Property not found. retry in 112.708154ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf
13202024-11-16T00:46:32.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89") failed: Property not found. retry in 1.270541853s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89
13212024-11-16T00:46:32.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3") failed: Property not found. retry in 841.901428ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
13222024-11-16T00:46:32.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf") failed: Property not found. retry in 143.237086ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf
13232024-11-16T00:46:32.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5") failed: Property not found. retry in 621.375416ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
13242024-11-16T00:46:33.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96") failed: Property not found. retry in 1.215358178s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96
13252024-11-16T00:46:33.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a") failed: Property not found. retry in 710.44312ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a
13262024-11-16T00:46:33.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf") failed: Property not found. retry in 478.173941ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf
13272024-11-16T00:46:33.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6") failed: Property not found. retry in 790.054334ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6
13282024-11-16T00:46:33.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490") failed: Property not found. retry in 655.038075ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490
13292024-11-16T00:46:33.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888") failed: Property not found. retry in 839.810275ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888
13302024-11-16T00:46:33.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd") failed: Property not found. retry in 732.500109ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
13312024-11-16T00:46:33.307ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13322024-11-16T00:46:33.307ZINFOSledAgent (ServiceManager): Booting oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29
13332024-11-16T00:46:33.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36") failed: Property not found. retry in 1.261691578s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36
13342024-11-16T00:46:33.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d") failed: Property not found. retry in 967.697595ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d
13352024-11-16T00:46:33.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214") failed: Property not found. retry in 820.616473ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214
13362024-11-16T00:46:33.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29") failed: Property not found. retry in 63.491329ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29
13372024-11-16T00:46:33.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf") failed: Property not found. retry in 780.781544ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf
13382024-11-16T00:46:33.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5") failed: Property not found. retry in 753.674164ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
13392024-11-16T00:46:33.608ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13402024-11-16T00:46:33.608ZINFOSledAgent (ServiceManager): Booting oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b
13412024-11-16T00:46:33.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29") failed: Property not found. retry in 132.505814ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29
13422024-11-16T00:46:33.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e") failed: Property not found. retry in 611.921727ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e
13432024-11-16T00:46:33.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3") failed: Property not found. retry in 1.393856792s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
13442024-11-16T00:46:33.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b") failed: Property not found. retry in 51.878829ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b
13452024-11-16T00:46:33.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29") failed: Property not found. retry in 184.759379ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29
13462024-11-16T00:46:33.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a") failed: Property not found. retry in 1.333156263s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a
13472024-11-16T00:46:33.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490") failed: Property not found. retry in 563.283973ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490
13482024-11-16T00:46:33.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b") failed: Property not found. retry in 64.29926ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b
13492024-11-16T00:46:33.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6") failed: Property not found. retry in 966.322265ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6
13502024-11-16T00:46:33.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9") failed: Property not found. retry in 1.377370449s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9
13512024-11-16T00:46:33.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b") failed: Property not found. retry in 163.498923ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b
13522024-11-16T00:46:33.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6") failed: Property not found. retry in 1.225531735s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6
13532024-11-16T00:46:33.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29") failed: Property not found. retry in 465.614492ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29
13542024-11-16T00:46:34.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd") failed: Property not found. retry in 1.410154774s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
13552024-11-16T00:46:34.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b") failed: Property not found. retry in 314.709721ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b
13562024-11-16T00:46:34.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888") failed: Property not found. retry in 1.168480802s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888
13572024-11-16T00:46:34.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89") failed: Property not found. retry in 1.167185921s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89
13582024-11-16T00:46:34.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96") failed: Property not found. retry in 1.384014989s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96
13592024-11-16T00:46:34.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e") failed: Property not found. retry in 592.857281ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e
13602024-11-16T00:46:34.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214") failed: Property not found. retry in 894.024134ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214
13612024-11-16T00:46:34.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5") failed: Property not found. retry in 1.094686455s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
13622024-11-16T00:46:34.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf") failed: Property not found. retry in 554.498614ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf
13632024-11-16T00:46:34.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490") failed: Property not found. retry in 1.274541587s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490
13642024-11-16T00:46:34.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b") failed: Property not found. retry in 560.648766ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b
13652024-11-16T00:46:34.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d") failed: Property not found. retry in 1.24343495s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d
13662024-11-16T00:46:34.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29") failed: Property not found. retry in 723.034808ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29
13672024-11-16T00:46:34.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36") failed: Property not found. retry in 933.557097ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36
13682024-11-16T00:46:34.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6") failed: Property not found. retry in 1.039520826s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6
13692024-11-16T00:46:34.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e") failed: Property not found. retry in 1.345107076s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e
13702024-11-16T00:46:34.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf") failed: Property not found. retry in 869.249107ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf
13712024-11-16T00:46:34.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b") failed: Property not found. retry in 1.424951396s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b
13722024-11-16T00:46:35.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a") failed: Property not found. retry in 1.26644251s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a
13732024-11-16T00:46:35.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6") failed: Property not found. retry in 1.205766514s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6
13742024-11-16T00:46:35.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3") failed: Property not found. retry in 1.062847535s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
13752024-11-16T00:46:35.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29") failed: Property not found. retry in 1.001185104s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29
13762024-11-16T00:46:35.231ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.53252052s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
13772024-11-16T00:46:35.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214") failed: Property not found. retry in 1.371576136s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214
13782024-11-16T00:46:35.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9") failed: Property not found. retry in 844.489504ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9
13792024-11-16T00:46:35.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888") failed: Property not found. retry in 744.821064ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888
13802024-11-16T00:46:35.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89") failed: Property not found. retry in 574.6746ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89
13812024-11-16T00:46:35.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd") failed: Property not found. retry in 622.154394ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
13822024-11-16T00:46:35.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5") failed: Property not found. retry in 581.733316ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
13832024-11-16T00:46:35.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36") failed: Property not found. retry in 1.276382005s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36
13842024-11-16T00:46:35.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96") failed: Property not found. retry in 1.281615938s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96
13852024-11-16T00:46:35.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490") failed: Property not found. retry in 799.611539ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490
13862024-11-16T00:46:35.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d") failed: Property not found. retry in 1.113810702s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d
13872024-11-16T00:46:35.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf") failed: Property not found. retry in 510.998971ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf
13882024-11-16T00:46:35.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6") failed: Property not found. retry in 1.421291132s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6
13892024-11-16T00:46:35.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89") failed: Property not found. retry in 1.281625149s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89
13902024-11-16T00:46:36.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888") failed: Property not found. retry in 564.88598ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888
13912024-11-16T00:46:36.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5") failed: Property not found. retry in 663.03097ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
13922024-11-16T00:46:36.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd") failed: Property not found. retry in 1.016453811s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
13932024-11-16T00:46:36.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9") failed: Property not found. retry in 843.654336ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9
13942024-11-16T00:46:36.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29") failed: Property not found. retry in 983.094916ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29
13952024-11-16T00:46:36.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3") failed: Property not found. retry in 602.756278ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
13962024-11-16T00:46:36.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e") failed: Property not found. retry in 1.214169911s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e
13972024-11-16T00:46:36.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf") failed: Property not found. retry in 708.339293ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf
13982024-11-16T00:46:36.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6") failed: Property not found. retry in 1.197950921s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6
13992024-11-16T00:46:36.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b") failed: Property not found. retry in 761.874967ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b
14002024-11-16T00:46:36.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a") failed: Property not found. retry in 956.305304ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a
14012024-11-16T00:46:36.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490") failed: Property not found. retry in 1.010888196s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490
14022024-11-16T00:46:36.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888") failed: Property not found. retry in 1.071065747s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888
14032024-11-16T00:46:36.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214") failed: Property not found. retry in 566.028933ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214
14042024-11-16T00:46:36.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5") failed: Property not found. retry in 531.424786ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
14052024-11-16T00:46:36.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d") failed: Property not found. retry in 1.368635779s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d
14062024-11-16T00:46:36.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3") failed: Property not found. retry in 1.340862475s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
14072024-11-16T00:46:36.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36") failed: Property not found. retry in 1.118015323s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36
14082024-11-16T00:46:36.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96") failed: Property not found. retry in 1.356067581s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96
14092024-11-16T00:46:36.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9") failed: Property not found. retry in 1.27459624s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9
14102024-11-16T00:46:37.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf") failed: Property not found. retry in 1.011649164s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf
14112024-11-16T00:46:37.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd") failed: Property not found. retry in 1.220513013s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
14122024-11-16T00:46:37.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b") failed: Property not found. retry in 1.16379629s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b
14132024-11-16T00:46:37.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89") failed: Property not found. retry in 796.716627ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89
14142024-11-16T00:46:37.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214") failed: Property not found. retry in 640.251204ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214
14152024-11-16T00:46:37.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29") failed: Property not found. retry in 900.217698ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29
14162024-11-16T00:46:37.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5") failed: Property not found. retry in 720.958349ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
14172024-11-16T00:46:37.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6") failed: Property not found. retry in 953.866065ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6
14182024-11-16T00:46:37.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a") failed: Property not found. retry in 966.541679ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a
14192024-11-16T00:46:37.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e") failed: Property not found. retry in 1.182435646s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e
14202024-11-16T00:46:37.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490") failed: Property not found. retry in 791.105758ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490
14212024-11-16T00:46:37.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6") failed: Property not found. retry in 745.237824ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6
14222024-11-16T00:46:37.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888") failed: Property not found. retry in 887.780878ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888
14232024-11-16T00:46:37.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214") failed: Property not found. retry in 1.021180164s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214
14242024-11-16T00:46:38.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5") failed: Property not found. retry in 997.606847ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
14252024-11-16T00:46:38.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89") failed: Property not found. retry in 814.000735ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89
14262024-11-16T00:46:38.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36") failed: Property not found. retry in 584.313759ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36
14272024-11-16T00:46:38.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf") failed: Property not found. retry in 542.377044ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf
14282024-11-16T00:46:38.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29") failed: Property not found. retry in 1.125186634s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29
14292024-11-16T00:46:38.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d") failed: Property not found. retry in 824.866995ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d
14302024-11-16T00:46:38.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3") failed: Property not found. retry in 656.345833ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
14312024-11-16T00:46:38.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9") failed: Property not found. retry in 1.339161002s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9
14322024-11-16T00:46:38.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6") failed: Property not found. retry in 739.008439ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6
14332024-11-16T00:46:38.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd") failed: Property not found. retry in 1.297639717s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
14342024-11-16T00:46:38.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96") failed: Property not found. retry in 786.223372ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96
14352024-11-16T00:46:38.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490") failed: Property not found. retry in 1.292850698s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490
14362024-11-16T00:46:38.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6") failed: Property not found. retry in 935.948177ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6
14372024-11-16T00:46:38.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b") failed: Property not found. retry in 660.598882ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b
14382024-11-16T00:46:38.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a") failed: Property not found. retry in 1.22177267s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a
14392024-11-16T00:46:38.500ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14402024-11-16T00:46:38.501ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1
14412024-11-16T00:46:38.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888") failed: Property not found. retry in 966.213497ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888
14422024-11-16T00:46:38.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf") failed: Property not found. retry in 934.760157ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf
14432024-11-16T00:46:38.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36") failed: Property not found. retry in 605.408313ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36
14442024-11-16T00:46:38.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e") failed: Property not found. retry in 1.204921463s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e
14452024-11-16T00:46:38.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1") failed: Property not found. retry in 31.274555ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1
14462024-11-16T00:46:38.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89") failed: Property not found. retry in 590.389122ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89
14472024-11-16T00:46:38.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1") failed: Property not found. retry in 115.022305ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1
14482024-11-16T00:46:38.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214") failed: Property not found. retry in 988.086112ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214
14492024-11-16T00:46:38.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3") failed: Property not found. retry in 848.394019ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
14502024-11-16T00:46:39.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1") failed: Property not found. retry in 236.96836ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1
14512024-11-16T00:46:39.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b") failed: Property not found. retry in 541.914829ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b
14522024-11-16T00:46:39.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96") failed: Property not found. retry in 1.491702799s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96
14532024-11-16T00:46:39.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6") failed: Property not found. retry in 1.037403739s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6
14542024-11-16T00:46:39.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d") failed: Property not found. retry in 1.37114796s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d
14552024-11-16T00:46:39.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5") failed: Property not found. retry in 848.538454ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
14562024-11-16T00:46:39.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36") failed: Property not found. retry in 950.105056ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36
14572024-11-16T00:46:39.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29") failed: Property not found. retry in 821.21135ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29
14582024-11-16T00:46:39.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6") failed: Property not found. retry in 1.241693459s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6
14592024-11-16T00:46:39.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1") failed: Property not found. retry in 467.370351ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1
14602024-11-16T00:46:39.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89") failed: Property not found. retry in 668.763829ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89
14612024-11-16T00:46:39.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888") failed: Property not found. retry in 873.823424ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888
14622024-11-16T00:46:39.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf") failed: Property not found. retry in 949.069697ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf
14632024-11-16T00:46:39.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9") failed: Property not found. retry in 767.057829ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9
14642024-11-16T00:46:39.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd") failed: Property not found. retry in 674.234587ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
14652024-11-16T00:46:39.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a") failed: Property not found. retry in 586.60157ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a
14662024-11-16T00:46:39.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490") failed: Property not found. retry in 771.547724ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490
14672024-11-16T00:46:39.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b") failed: Property not found. retry in 1.179235942s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b
14682024-11-16T00:46:39.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3") failed: Property not found. retry in 557.959328ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
14692024-11-16T00:46:39.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214") failed: Property not found. retry in 1.191689993s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214
14702024-11-16T00:46:39.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1") failed: Property not found. retry in 623.442602ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1
14712024-11-16T00:46:39.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e") failed: Property not found. retry in 1.467409339s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e
14722024-11-16T00:46:40.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89") failed: Property not found. retry in 666.476867ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89
14732024-11-16T00:46:40.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5") failed: Property not found. retry in 705.624656ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
14742024-11-16T00:46:40.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29") failed: Property not found. retry in 898.625308ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29
14752024-11-16T00:46:40.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36") failed: Property not found. retry in 1.456639383s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36
14762024-11-16T00:46:40.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6") failed: Property not found. retry in 754.729395ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6
14772024-11-16T00:46:40.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a") failed: Property not found. retry in 1.331674064s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a
14782024-11-16T00:46:40.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd") failed: Property not found. retry in 981.693543ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
14792024-11-16T00:46:40.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3") failed: Property not found. retry in 871.218154ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
14802024-11-16T00:46:40.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9") failed: Property not found. retry in 915.493649ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9
14812024-11-16T00:46:40.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888") failed: Property not found. retry in 1.157154412s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888
14822024-11-16T00:46:40.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490") failed: Property not found. retry in 1.284271039s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490
14832024-11-16T00:46:40.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1") failed: Property not found. retry in 874.75997ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1
14842024-11-16T00:46:40.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf") failed: Property not found. retry in 1.235127901s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf
14852024-11-16T00:46:40.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6") failed: Property not found. retry in 1.296524971s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6
14862024-11-16T00:46:40.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d") failed: Property not found. retry in 717.128754ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d
14872024-11-16T00:46:40.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96") failed: Property not found. retry in 1.1848341s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96
14882024-11-16T00:46:40.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89") failed: Property not found. retry in 1.193124118s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89
14892024-11-16T00:46:40.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5") failed: Property not found. retry in 671.43114ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
14902024-11-16T00:46:40.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b") failed: Property not found. retry in 560.6007ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b
14912024-11-16T00:46:41.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6") failed: Property not found. retry in 752.495748ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6
14922024-11-16T00:46:41.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29") failed: Property not found. retry in 1.078329471s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29
14932024-11-16T00:46:41.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214") failed: Property not found. retry in 1.224412638s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214
14942024-11-16T00:46:41.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3") failed: Property not found. retry in 738.999315ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
14952024-11-16T00:46:41.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd") failed: Property not found. retry in 573.577125ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
14962024-11-16T00:46:41.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9") failed: Property not found. retry in 1.106909579s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9
14972024-11-16T00:46:41.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d") failed: Property not found. retry in 1.274775632s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d
14982024-11-16T00:46:41.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e") failed: Property not found. retry in 1.174749936s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e
14992024-11-16T00:46:41.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1") failed: Property not found. retry in 1.118216854s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1
15002024-11-16T00:46:41.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b") failed: Property not found. retry in 1.486691239s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b
15012024-11-16T00:46:41.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5") failed: Property not found. retry in 565.642945ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
15022024-11-16T00:46:41.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a") failed: Property not found. retry in 1.231057251s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a
15032024-11-16T00:46:41.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888") failed: Property not found. retry in 1.283909043s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888
15042024-11-16T00:46:41.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36") failed: Property not found. retry in 830.51098ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36
15052024-11-16T00:46:41.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490") failed: Property not found. retry in 828.810469ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490
15062024-11-16T00:46:41.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf") failed: Property not found. retry in 597.977142ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf
15072024-11-16T00:46:41.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6") failed: Property not found. retry in 922.353506ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6
15082024-11-16T00:46:41.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96") failed: Property not found. retry in 1.405103492s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96
15092024-11-16T00:46:41.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6") failed: Property not found. retry in 1.074964674s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6
15102024-11-16T00:46:41.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd") failed: Property not found. retry in 512.281467ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
15112024-11-16T00:46:42.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3") failed: Property not found. retry in 664.86429ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
15122024-11-16T00:46:42.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89") failed: Property not found. retry in 1.285897241s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89
15132024-11-16T00:46:42.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5") failed: Property not found. retry in 1.101870848s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
15142024-11-16T00:46:42.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29") failed: Property not found. retry in 763.752573ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29
15152024-11-16T00:46:42.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214") failed: Property not found. retry in 1.389687428s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214
15162024-11-16T00:46:42.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf") failed: Property not found. retry in 716.713892ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf
15172024-11-16T00:46:42.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd") failed: Property not found. retry in 502.741692ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
15182024-11-16T00:46:42.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9") failed: Property not found. retry in 569.624488ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9
15192024-11-16T00:46:42.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1") failed: Property not found. retry in 685.247783ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1
15202024-11-16T00:46:42.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36") failed: Property not found. retry in 543.427884ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36
15212024-11-16T00:46:42.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e") failed: Property not found. retry in 815.880864ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e
15222024-11-16T00:46:42.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490") failed: Property not found. retry in 916.877139ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490
15232024-11-16T00:46:42.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d") failed: Property not found. retry in 1.010301891s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d
15242024-11-16T00:46:42.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3") failed: Property not found. retry in 1.016410843s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
15252024-11-16T00:46:42.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6") failed: Property not found. retry in 1.487513112s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6
15262024-11-16T00:46:42.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a") failed: Property not found. retry in 1.173335212s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a
15272024-11-16T00:46:42.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29") failed: Property not found. retry in 817.077334ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29
15282024-11-16T00:46:42.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888") failed: Property not found. retry in 780.684754ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888
15292024-11-16T00:46:42.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd") failed: Property not found. retry in 751.838209ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
15302024-11-16T00:46:43.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6") failed: Property not found. retry in 501.962931ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6
15312024-11-16T00:46:43.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b") failed: Property not found. retry in 1.322876796s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b
15322024-11-16T00:46:43.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9") failed: Property not found. retry in 1.456721867s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9
15332024-11-16T00:46:43.069ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39707
15342024-11-16T00:46:43.076ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6265 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39707 req_id = e2475751-8057-40f5-8fa8-eb1b4050fa3e response_code = 200 uri = /baseboard
15352024-11-16T00:46:43.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36") failed: Property not found. retry in 708.651773ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36
15362024-11-16T00:46:43.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf") failed: Property not found. retry in 1.4192948s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf
15372024-11-16T00:46:43.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5") failed: Property not found. retry in 546.192117ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
15382024-11-16T00:46:43.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1") failed: Property not found. retry in 656.10664ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1
15392024-11-16T00:46:43.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89") failed: Property not found. retry in 808.854548ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89
15402024-11-16T00:46:43.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96") failed: Property not found. retry in 577.520735ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96
15412024-11-16T00:46:43.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e") failed: Property not found. retry in 523.411543ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e
15422024-11-16T00:46:43.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6") failed: Property not found. retry in 1.235190366s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6
15432024-11-16T00:46:43.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490") failed: Property not found. retry in 1.011027709s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490
15442024-11-16T00:46:43.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3") failed: Property not found. retry in 1.173279127s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
15452024-11-16T00:46:43.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888") failed: Property not found. retry in 717.480516ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888
15462024-11-16T00:46:43.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd") failed: Property not found. retry in 1.352988476s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
15472024-11-16T00:46:43.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214") failed: Property not found. retry in 585.984004ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214
15482024-11-16T00:46:43.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29") failed: Property not found. retry in 1.47127358s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29
15492024-11-16T00:46:43.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5") failed: Property not found. retry in 1.40258176s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
15502024-11-16T00:46:43.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36") failed: Property not found. retry in 1.141311131s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36
15512024-11-16T00:46:43.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96") failed: Property not found. retry in 755.774072ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96
15522024-11-16T00:46:43.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1") failed: Property not found. retry in 1.256701422s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1
15532024-11-16T00:46:43.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e") failed: Property not found. retry in 891.340775ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e
15542024-11-16T00:46:44.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a") failed: Property not found. retry in 662.912213ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a
15552024-11-16T00:46:44.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6") failed: Property not found. retry in 1.331598018s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6
15562024-11-16T00:46:44.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b") failed: Property not found. retry in 1.377343183s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b
15572024-11-16T00:46:44.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214") failed: Property not found. retry in 657.495374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214
15582024-11-16T00:46:44.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888") failed: Property not found. retry in 968.637865ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888
15592024-11-16T00:46:44.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a") failed: Property not found. retry in 888.216722ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a
15602024-11-16T00:46:45.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1") failed: Property not found. retry in 719.347503ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1
15612024-11-16T00:46:45.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1") failed: Property not found. retry in 829.066582ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1
15622024-11-16T00:46:46.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1") failed: Property not found. retry in 1.160839631s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1
15632024-11-16T00:46:48.027ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_44e32ae0-e49c-4d3f-9d58-d04410c9ffa6
15642024-11-16T00:46:48.027ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_569788cc-821e-4658-948b-5e5a34a278f1
15652024-11-16T00:46:48.027ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_6d7cf1e6-3ed9-42bc-8f17-49159affac6b
15662024-11-16T00:46:48.027ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_ff27fc99-a5d9-4c14-972a-fc3b1a67eb96
15672024-11-16T00:46:48.027ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_4c8ef314-c004-428d-a00a-64bc786ac3a6
15682024-11-16T00:46:48.027ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_7e8da82b-fd0a-41d9-9320-a043430b9e89
15692024-11-16T00:46:48.027ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888
15702024-11-16T00:46:48.027ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_aa8ef199-ff13-4bdb-b31a-e6207556abcd
15712024-11-16T00:46:48.027ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_0bf20a8b-7bf7-416f-83ed-8569fc9c1490
15722024-11-16T00:46:48.027ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_d011d103-e2d3-4e31-99a3-702678d6e86a
15732024-11-16T00:46:48.027ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_8a30a7ac-6c9e-413d-88bb-25f574dec214
15742024-11-16T00:46:48.027ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_13730105-f533-4f95-87fb-90f1e57f672d
15752024-11-16T00:46:48.027ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_575b7fa0-5470-497f-a336-37cec1374bc5
15762024-11-16T00:46:48.027ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_a539f104-82d1-43cd-96eb-70a7ebd036e9
15772024-11-16T00:46:48.027ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_68d1de56-2fd6-46e0-a2b5-ea6e8c6f6f36
15782024-11-16T00:46:48.027ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_cebce92a-579a-4295-b410-4ce799c5bf29
15792024-11-16T00:46:48.027ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_0b4fb600-f4f3-47ea-b984-9bf63673ff3e
15802024-11-16T00:46:48.027ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf
15812024-11-16T00:46:48.027ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_b240ea0f-29c5-4b63-8b2b-01e85c8917f3
15822024-11-16T00:46:48.027ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15832024-11-16T00:46:48.030ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15842024-11-16T00:46:48.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28360906 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:45275 req_id = 67b5ba29-2fb2-461f-a1f3-615248d8cdd8 response_code = 204 uri = /omicron-zones
15852024-11-16T00:46:48.035ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1448
15862024-11-16T00:46:48.036ZINFOSledAgent (RSS): Writing ledger to /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15872024-11-16T00:46:48.039ZINFOSledAgent (RSS): Writing ledger to /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15882024-11-16T00:46:48.041ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:787
15892024-11-16T00:46:48.044ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:799
15902024-11-16T00:46:48.083ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1013
15912024-11-16T00:46:48.086ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b933f208-5503-4ef4-a58c-ba230a4cccac/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
15922024-11-16T00:46:48.170ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b933f208-5503-4ef4-a58c-ba230a4cccac/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
15932024-11-16T00:46:48.296ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b933f208-5503-4ef4-a58c-ba230a4cccac/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
15942024-11-16T00:46:48.508ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b933f208-5503-4ef4-a58c-ba230a4cccac/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
15952024-11-16T00:46:48.745ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b933f208-5503-4ef4-a58c-ba230a4cccac/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
15962024-11-16T00:46:48.961ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b933f208-5503-4ef4-a58c-ba230a4cccac/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
15972024-11-16T00:46:49.172ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b933f208-5503-4ef4-a58c-ba230a4cccac/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
15982024-11-16T00:46:49.410ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b933f208-5503-4ef4-a58c-ba230a4cccac/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
15992024-11-16T00:46:49.728ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b933f208-5503-4ef4-a58c-ba230a4cccac/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16002024-11-16T00:46:50.201ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b933f208-5503-4ef4-a58c-ba230a4cccac/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16012024-11-16T00:46:50.637ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b933f208-5503-4ef4-a58c-ba230a4cccac/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16022024-11-16T00:46:51.816ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.931254854s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
16032024-11-16T00:46:54.086ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e78c4ba0-3519-42cb-bedc-994834ad2b22", "content-length": "173", "date": "Sat, 16 Nov 2024 00:46:54 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"b933f208-5503-4ef4-a58c-ba230a4cccac\"", request_id: "e78c4ba0-3519-42cb-bedc-994834ad2b22" } file = sled-agent/src/rack_setup/service.rs:1075
16042024-11-16T00:46:54.779ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b9bfcd9e-1259-49ab-bae7-d1325e2da1bb", "content-length": "173", "date": "Sat, 16 Nov 2024 00:46:54 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"b933f208-5503-4ef4-a58c-ba230a4cccac\"", request_id: "b9bfcd9e-1259-49ab-bae7-d1325e2da1bb" } file = sled-agent/src/rack_setup/service.rs:1075
16052024-11-16T00:46:55.663ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d40b199b-ea37-4ea8-b6ec-0214a05c4656", "content-length": "173", "date": "Sat, 16 Nov 2024 00:46:54 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"b933f208-5503-4ef4-a58c-ba230a4cccac\"", request_id: "d40b199b-ea37-4ea8-b6ec-0214a05c4656" } file = sled-agent/src/rack_setup/service.rs:1075
16062024-11-16T00:46:56.495ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.517949363s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"310cd252-c87f-4056-88eb-b0ff6d86342f\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Sat, 16 Nov 2024 00:46:55 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"310cd252-c87f-4056-88eb-b0ff6d86342f\\" }" file = oximeter/producer/src/lib.rs:420 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
16072024-11-16T00:46:57.140ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3d26e09a-3566-43fb-953b-391a4c8d6220", "content-length": "173", "date": "Sat, 16 Nov 2024 00:46:57 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"b933f208-5503-4ef4-a58c-ba230a4cccac\"", request_id: "3d26e09a-3566-43fb-953b-391a4c8d6220" } file = sled-agent/src/rack_setup/service.rs:1075
16082024-11-16T00:46:58.062ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0697b1f1-c8b5-4d09-a623-f15f3c748b97", "content-length": "173", "date": "Sat, 16 Nov 2024 00:46:58 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"b933f208-5503-4ef4-a58c-ba230a4cccac\"", request_id: "0697b1f1-c8b5-4d09-a623-f15f3c748b97" } file = sled-agent/src/rack_setup/service.rs:1075
16092024-11-16T00:47:01.287ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e16d3948-27d8-4c3c-a34a-c88c29ebbe5c", "content-length": "173", "date": "Sat, 16 Nov 2024 00:47:01 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ad7c66bd-0d53-43e9-89e8-86e0651ea05d\"", request_id: "e16d3948-27d8-4c3c-a34a-c88c29ebbe5c" } file = sled-agent/src/rack_setup/service.rs:1075
16102024-11-16T00:47:05.051ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 17.114202297s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"ba2c8f0d-1713-456c-b729-aa59b20b4f62\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Sat, 16 Nov 2024 00:47:05 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"ba2c8f0d-1713-456c-b729-aa59b20b4f62\\" }" file = oximeter/producer/src/lib.rs:420 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
16112024-11-16T00:47:05.358ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f3c2ac91-bbd3-4a82-9be5-4a7d43d5e0c1", "content-length": "173", "date": "Sat, 16 Nov 2024 00:47:05 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ad7c66bd-0d53-43e9-89e8-86e0651ea05d\"", request_id: "f3c2ac91-bbd3-4a82-9be5-4a7d43d5e0c1" } file = sled-agent/src/rack_setup/service.rs:1075
16122024-11-16T00:47:07.425ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a25373a6-819e-45f0-abc4-c5a6759094d6", "content-length": "173", "date": "Sat, 16 Nov 2024 00:47:06 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ad7c66bd-0d53-43e9-89e8-86e0651ea05d\"", request_id: "a25373a6-819e-45f0-abc4-c5a6759094d6" } file = sled-agent/src/rack_setup/service.rs:1075
16132024-11-16T00:47:10.006ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d96445f4-3a4d-462e-a4d3-a12594c86d19", "content-length": "173", "date": "Sat, 16 Nov 2024 00:47:10 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ad7c66bd-0d53-43e9-89e8-86e0651ea05d\"", request_id: "d96445f4-3a4d-462e-a4d3-a12594c86d19" } file = sled-agent/src/rack_setup/service.rs:1075
16142024-11-16T00:47:13.111ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52048
16152024-11-16T00:47:13.111ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52048 req_id = 51c76a60-eb46-4a41-8180-ade156bc3ae7 response_code = 200 uri = /baseboard
16162024-11-16T00:47:15.189ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ec7d8c03-db87-4b24-8aa8-84fbf51f86eb", "content-length": "173", "date": "Sat, 16 Nov 2024 00:47:14 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ad7c66bd-0d53-43e9-89e8-86e0651ea05d\"", request_id: "ec7d8c03-db87-4b24-8aa8-84fbf51f86eb" } file = sled-agent/src/rack_setup/service.rs:1075
16172024-11-16T00:47:18.448ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1d6282b0-5bb2-49dc-8620-1737ab22d15a", "content-length": "173", "date": "Sat, 16 Nov 2024 00:47:18 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ad7c66bd-0d53-43e9-89e8-86e0651ea05d\"", request_id: "1d6282b0-5bb2-49dc-8620-1737ab22d15a" } file = sled-agent/src/rack_setup/service.rs:1075
16182024-11-16T00:47:23.440ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0447016b-02a4-4896-8a19-93f0283d14db", "content-length": "173", "date": "Sat, 16 Nov 2024 00:47:23 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ad7c66bd-0d53-43e9-89e8-86e0651ea05d\"", request_id: "0447016b-02a4-4896-8a19-93f0283d14db" } file = sled-agent/src/rack_setup/service.rs:1075
16192024-11-16T00:47:25.701ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
16202024-11-16T00:47:25.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47843
16212024-11-16T00:47:25.789ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16222024-11-16T00:47:25.789ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16232024-11-16T00:47:25.790ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/omicron-zones.json file = common/src/ledger.rs:177
16242024-11-16T00:47:25.790ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/omicron-zones.json file = common/src/ledger.rs:177
16252024-11-16T00:47:25.802ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16262024-11-16T00:47:25.802ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8dfb8147-eb55-4ee1-89a5-25b2d27c68ee
16272024-11-16T00:47:25.826ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16282024-11-16T00:47:25.826ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d49e8c8c-eb53-43b6-a176-aee4725796df
16292024-11-16T00:47:25.853ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16302024-11-16T00:47:25.853ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_220cf814-be1b-400b-bb43-5ab45b7eb044
16312024-11-16T00:47:25.876ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16322024-11-16T00:47:25.876ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b3e7398e-9645-46d0-a57a-4bd06e1408a3
16332024-11-16T00:47:25.902ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16342024-11-16T00:47:25.902ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_eb288506-11eb-4ffc-bf84-f6c1550028b7
16352024-11-16T00:47:25.924ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2df48cc0-997e-4c6b-92f6-f05e369b8ceb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16362024-11-16T00:47:25.924ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2df48cc0-997e-4c6b-92f6-f05e369b8ceb
16372024-11-16T00:47:25.946ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 769d1181-4cb2-4e0f-87be-d1b20a8a9c58 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16382024-11-16T00:47:25.946ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_769d1181-4cb2-4e0f-87be-d1b20a8a9c58
16392024-11-16T00:47:25.966ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16402024-11-16T00:47:25.966ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad26846d-9efb-4f49-8d19-f73f5a25617e
16412024-11-16T00:47:25.989ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16422024-11-16T00:47:25.989ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_96d0d34c-625d-45e2-b0db-1fbc7541f944
16432024-11-16T00:47:26.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212977 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47843 req_id = 216af9eb-d8ab-4a3d-9c6f-3e2e48d9c634 response_code = 200 uri = /inventory
16442024-11-16T00:47:27.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32797
16452024-11-16T00:47:27.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1535 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32797 req_id = f6fdd878-207e-4aaf-92df-6fb5521cad9a response_code = 200 uri = /vpc-routes
16462024-11-16T00:47:27.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37519
16472024-11-16T00:47:27.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37519 req_id = 8bae8d37-60c9-4b32-911f-d47a1c77a8e5 response_code = 200 uri = /vpc-routes
16482024-11-16T00:47:27.510ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
16492024-11-16T00:47:27.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1556 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32797 req_id = a8826aa8-9689-4835-bad6-77d412b7cb2e response_code = 204 uri = /eip-gateways
16502024-11-16T00:47:27.547ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58090
16512024-11-16T00:47:27.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58090 req_id = fd1cf783-c002-4de7-9cb4-eb42c4bc991d response_code = 200 uri = /v2p
16522024-11-16T00:47:27.561ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
16532024-11-16T00:47:27.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37519 req_id = 7988013a-38e5-442b-94dc-bbd0f8c4a296 response_code = 204 uri = /eip-gateways
16542024-11-16T00:47:27.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3425 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37519 req_id = 5a90e392-b445-444a-b072-705c3d71cf2d response_code = 204 uri = /vpc-routes
16552024-11-16T00:47:27.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64285
16562024-11-16T00:47:27.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64285 req_id = 0890c35b-b725-4d83-9a90-3a852fce245f response_code = 200 uri = /v2p
16572024-11-16T00:47:27.713ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
16582024-11-16T00:47:27.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32797 req_id = ce983183-78db-4c27-8451-ae4bec4e3702 response_code = 204 uri = /vpc-routes
16592024-11-16T00:47:29.646ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36931
16602024-11-16T00:47:29.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36931 req_id = 9fa08f2e-f9ca-4a78-bd26-d47228e17cc4 response_code = 200 uri = /vpc-routes
16612024-11-16T00:47:29.686ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
16622024-11-16T00:47:29.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36931 req_id = f8c04c3f-b30c-49b5-9803-659f47684a60 response_code = 204 uri = /eip-gateways
16632024-11-16T00:47:29.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36931 req_id = 5cbc11a3-591c-4f11-963d-a5b35906bc8a response_code = 204 uri = /vpc-routes
16642024-11-16T00:47:29.748ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46744
16652024-11-16T00:47:29.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46744 req_id = 3c85ae8b-f051-4c5b-9579-e2083f96a0a8 response_code = 200 uri = /v2p
16662024-11-16T00:47:31.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61136
16672024-11-16T00:47:31.623ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 590b90e0-533a-4c8d-9965-a74bed460cd8, kind: Service { id: 3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888 }, name: Name("external-dns-3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 11])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 729e6010-0a28-4302-8831-f6612b85a78f, kind: Service { id: 4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf }, name: Name("external-dns-4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4c60317e-983a-4ac6-8708-96d944c78888, kind: Service { id: 6d7cf1e6-3ed9-42bc-8f17-49159affac6b }, name: Name("nexus-6d7cf1e6-3ed9-42bc-8f17-49159affac6b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 86c67e2b-8c46-4e16-8253-9de9bc79f0fa, kind: Service { id: cebce92a-579a-4295-b410-4ce799c5bf29 }, name: Name("nexus-cebce92a-579a-4295-b410-4ce799c5bf29"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa85ba01-9643-4c9d-8080-62de967b5b63, kind: Service { id: ff27fc99-a5d9-4c14-972a-fc3b1a67eb96 }, name: Name("nexus-ff27fc99-a5d9-4c14-972a-fc3b1a67eb96"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 158])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16682024-11-16T00:47:31.623ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16692024-11-16T00:47:31.623ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16702024-11-16T00:47:31.623ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16712024-11-16T00:47:31.623ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16722024-11-16T00:47:31.623ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
16732024-11-16T00:47:31.623ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16742024-11-16T00:47:31.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1545 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61136 req_id = ad9ac24d-becd-4517-bfe7-5acc7f679b08 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16752024-11-16T00:47:31.624ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1085
16762024-11-16T00:47:31.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42545
16772024-11-16T00:47:31.840ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16782024-11-16T00:47:31.840ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16792024-11-16T00:47:31.840ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/omicron-zones.json file = common/src/ledger.rs:177
16802024-11-16T00:47:31.841ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/omicron-zones.json file = common/src/ledger.rs:177
16812024-11-16T00:47:31.852ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16822024-11-16T00:47:31.852ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8dfb8147-eb55-4ee1-89a5-25b2d27c68ee
16832024-11-16T00:47:31.878ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16842024-11-16T00:47:31.878ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d49e8c8c-eb53-43b6-a176-aee4725796df
16852024-11-16T00:47:31.902ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16862024-11-16T00:47:31.902ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_220cf814-be1b-400b-bb43-5ab45b7eb044
16872024-11-16T00:47:31.924ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16882024-11-16T00:47:31.924ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b3e7398e-9645-46d0-a57a-4bd06e1408a3
16892024-11-16T00:47:31.949ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16902024-11-16T00:47:31.949ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_eb288506-11eb-4ffc-bf84-f6c1550028b7
16912024-11-16T00:47:31.970ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2df48cc0-997e-4c6b-92f6-f05e369b8ceb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16922024-11-16T00:47:31.970ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2df48cc0-997e-4c6b-92f6-f05e369b8ceb
16932024-11-16T00:47:31.990ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 769d1181-4cb2-4e0f-87be-d1b20a8a9c58 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16942024-11-16T00:47:31.990ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_769d1181-4cb2-4e0f-87be-d1b20a8a9c58
16952024-11-16T00:47:32.012ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16962024-11-16T00:47:32.012ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad26846d-9efb-4f49-8d19-f73f5a25617e
16972024-11-16T00:47:32.035ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16982024-11-16T00:47:32.035ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_96d0d34c-625d-45e2-b0db-1fbc7541f944
16992024-11-16T00:47:32.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208706 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42545 req_id = eafc05b6-274b-4b35-8453-b0587a80559b response_code = 200 uri = /inventory
17002024-11-16T00:47:32.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42091
17012024-11-16T00:47:32.912ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 590b90e0-533a-4c8d-9965-a74bed460cd8, kind: Service { id: 3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888 }, name: Name("external-dns-3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 11])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 729e6010-0a28-4302-8831-f6612b85a78f, kind: Service { id: 4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf }, name: Name("external-dns-4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4c60317e-983a-4ac6-8708-96d944c78888, kind: Service { id: 6d7cf1e6-3ed9-42bc-8f17-49159affac6b }, name: Name("nexus-6d7cf1e6-3ed9-42bc-8f17-49159affac6b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 86c67e2b-8c46-4e16-8253-9de9bc79f0fa, kind: Service { id: cebce92a-579a-4295-b410-4ce799c5bf29 }, name: Name("nexus-cebce92a-579a-4295-b410-4ce799c5bf29"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa85ba01-9643-4c9d-8080-62de967b5b63, kind: Service { id: ff27fc99-a5d9-4c14-972a-fc3b1a67eb96 }, name: Name("nexus-ff27fc99-a5d9-4c14-972a-fc3b1a67eb96"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 158])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17022024-11-16T00:47:32.912ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17032024-11-16T00:47:32.912ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17042024-11-16T00:47:32.912ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17052024-11-16T00:47:32.912ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17062024-11-16T00:47:32.912ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
17072024-11-16T00:47:32.912ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17082024-11-16T00:47:32.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 333 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42091 req_id = 76f26ed7-3b5c-4f8d-83f1-cd9535cd6d8a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17092024-11-16T00:47:33.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55861
17102024-11-16T00:47:33.503ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 590b90e0-533a-4c8d-9965-a74bed460cd8, kind: Service { id: 3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888 }, name: Name("external-dns-3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 11])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 729e6010-0a28-4302-8831-f6612b85a78f, kind: Service { id: 4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf }, name: Name("external-dns-4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4c60317e-983a-4ac6-8708-96d944c78888, kind: Service { id: 6d7cf1e6-3ed9-42bc-8f17-49159affac6b }, name: Name("nexus-6d7cf1e6-3ed9-42bc-8f17-49159affac6b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 86c67e2b-8c46-4e16-8253-9de9bc79f0fa, kind: Service { id: cebce92a-579a-4295-b410-4ce799c5bf29 }, name: Name("nexus-cebce92a-579a-4295-b410-4ce799c5bf29"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa85ba01-9643-4c9d-8080-62de967b5b63, kind: Service { id: ff27fc99-a5d9-4c14-972a-fc3b1a67eb96 }, name: Name("nexus-ff27fc99-a5d9-4c14-972a-fc3b1a67eb96"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 158])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17112024-11-16T00:47:33.503ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17122024-11-16T00:47:33.503ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17132024-11-16T00:47:33.503ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17142024-11-16T00:47:33.503ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17152024-11-16T00:47:33.503ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
17162024-11-16T00:47:33.503ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17172024-11-16T00:47:33.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55861 req_id = aea6f5b5-5924-4893-9d74-8ad7b71c684a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17182024-11-16T00:47:33.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53331
17192024-11-16T00:47:33.532ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 590b90e0-533a-4c8d-9965-a74bed460cd8, kind: Service { id: 3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888 }, name: Name("external-dns-3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 11])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 729e6010-0a28-4302-8831-f6612b85a78f, kind: Service { id: 4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf }, name: Name("external-dns-4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4c60317e-983a-4ac6-8708-96d944c78888, kind: Service { id: 6d7cf1e6-3ed9-42bc-8f17-49159affac6b }, name: Name("nexus-6d7cf1e6-3ed9-42bc-8f17-49159affac6b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 86c67e2b-8c46-4e16-8253-9de9bc79f0fa, kind: Service { id: cebce92a-579a-4295-b410-4ce799c5bf29 }, name: Name("nexus-cebce92a-579a-4295-b410-4ce799c5bf29"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa85ba01-9643-4c9d-8080-62de967b5b63, kind: Service { id: ff27fc99-a5d9-4c14-972a-fc3b1a67eb96 }, name: Name("nexus-ff27fc99-a5d9-4c14-972a-fc3b1a67eb96"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 158])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17202024-11-16T00:47:33.532ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17212024-11-16T00:47:33.532ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17222024-11-16T00:47:33.532ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17232024-11-16T00:47:33.532ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17242024-11-16T00:47:33.532ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
17252024-11-16T00:47:33.532ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17262024-11-16T00:47:33.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53331 req_id = 676b81fe-3950-4f0e-9d75-a9a7e6e6dc8b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17272024-11-16T00:47:35.483ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:51383 remote_addr = [fd00:1122:3344:101::d]:61994 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
17282024-11-16T00:47:35.502ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 17876 local_addr = [fd00:1122:3344:101::1]:51383 method = GET remote_addr = [fd00:1122:3344:101::d]:61994 req_id = 8bcc5025-6bf5-47b5-97f2-02d210ea39f8 response_code = 200 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d uri = /ad7c66bd-0d53-43e9-89e8-86e0651ea05d
17292024-11-16T00:47:40.587ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49260
17302024-11-16T00:47:40.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49260 req_id = 684dba72-1586-4ec4-9197-e21a5b1167ca response_code = 200 uri = /vpc-routes
17312024-11-16T00:47:40.602ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
17322024-11-16T00:47:40.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49260 req_id = ebce4a55-e618-4fd5-9af1-f68b3ead40f4 response_code = 204 uri = /eip-gateways
17332024-11-16T00:47:40.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49260 req_id = 30283de3-3780-4a57-b849-a5e736d53a87 response_code = 204 uri = /vpc-routes
17342024-11-16T00:47:43.145ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41101
17352024-11-16T00:47:43.145ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41101 req_id = 5fc6f357-a04a-4d77-8d58-776b195e41f4 response_code = 200 uri = /baseboard
17362024-11-16T00:47:57.574ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45944
17372024-11-16T00:47:57.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45944 req_id = e0a321b8-e82e-4cb3-823f-232e85b6aa84 response_code = 200 uri = /vpc-routes
17382024-11-16T00:47:57.638ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
17392024-11-16T00:47:57.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45944 req_id = bf9dc6fd-3cd7-452f-9b6f-9481d71d33f5 response_code = 204 uri = /eip-gateways
17402024-11-16T00:47:57.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45944 req_id = b90a5f3a-414c-4be4-af0a-78240f7bf498 response_code = 204 uri = /vpc-routes
17412024-11-16T00:47:57.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64921
17422024-11-16T00:47:57.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64921 req_id = e193a895-0621-4860-8293-7b8ee095b53a response_code = 200 uri = /vpc-routes
17432024-11-16T00:47:57.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37981
17442024-11-16T00:47:57.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37981 req_id = 4ac92e5e-f92c-459f-a3ca-941c2171c2cb response_code = 200 uri = /v2p
17452024-11-16T00:47:57.720ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
17462024-11-16T00:47:57.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64921 req_id = 604678ec-24fc-4797-851d-191ac3fc051d response_code = 204 uri = /eip-gateways
17472024-11-16T00:47:57.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64921 req_id = 9cdc969d-72bc-4cc2-a798-3f32ae39196b response_code = 204 uri = /vpc-routes
17482024-11-16T00:47:57.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49604
17492024-11-16T00:47:57.785ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17502024-11-16T00:47:57.860ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17512024-11-16T00:47:57.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141391 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49604 req_id = 8e9c1f45-c38d-44a9-8f1c-0dc80f1d053f response_code = 204 uri = /switch-ports
17522024-11-16T00:47:57.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37619
17532024-11-16T00:47:57.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37619 req_id = 05f51bf8-75e5-46cc-a34c-a8cc2318f92f response_code = 200 uri = /v2p
17542024-11-16T00:47:57.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1878 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49604 req_id = 361a1ddc-ed66-4f8e-a40f-fb1c03dc1f98 response_code = 200 uri = /network-bootstore-config
17552024-11-16T00:47:57.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64916
17562024-11-16T00:47:57.969ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17572024-11-16T00:47:58.008ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17582024-11-16T00:47:58.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88153 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64916 req_id = 2b89d809-5304-4d3a-be0b-0f56bcb91860 response_code = 204 uri = /switch-ports
17592024-11-16T00:47:58.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64916 req_id = 1d29ba59-e3fc-44e3-8cd7-c75f6c33e19e response_code = 200 uri = /network-bootstore-config
17602024-11-16T00:47:58.058ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
17612024-11-16T00:47:58.058ZINFOSledAgent (bootstore): Writing ledger to /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
17622024-11-16T00:47:58.059ZINFOSledAgent (bootstore): Writing ledger to /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
17632024-11-16T00:47:58.060ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
17642024-11-16T00:47:58.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49604 req_id = dbcdfa9b-895c-4206-bcb4-569fadf848cd response_code = 204 uri = /network-bootstore-config
17652024-11-16T00:47:59.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55444
17662024-11-16T00:47:59.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55444 req_id = 9d52c430-4b49-4ef2-a80c-203d216e8380 response_code = 200 uri = /vpc-routes
17672024-11-16T00:47:59.915ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
17682024-11-16T00:47:59.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55444 req_id = a0dd047c-6a57-4576-a7a7-6d4f7e3bcda2 response_code = 204 uri = /eip-gateways
17692024-11-16T00:48:00.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35816
17702024-11-16T00:48:00.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35816 req_id = 79153647-3da4-4493-853b-dbab7f7e93fa response_code = 200 uri = /v2p
17712024-11-16T00:48:00.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55444 req_id = 71e66875-8c9c-4f96-81b3-3cc8498a86c2 response_code = 204 uri = /vpc-routes
17722024-11-16T00:48:00.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45895
17732024-11-16T00:48:00.173ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17742024-11-16T00:48:00.209ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17752024-11-16T00:48:00.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86941 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45895 req_id = 7687d567-355b-489d-a037-ccae5bf479c1 response_code = 204 uri = /switch-ports
17762024-11-16T00:48:00.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45895 req_id = 97ae1958-78fb-4788-a1df-0ad3aa4db578 response_code = 200 uri = /network-bootstore-config
17772024-11-16T00:48:13.179ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51616
17782024-11-16T00:48:13.180ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51616 req_id = 066a1086-6c40-4d52-9266-415a2977536e response_code = 200 uri = /baseboard
17792024-11-16T00:48:27.545ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55083
17802024-11-16T00:48:27.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55083 req_id = 30a10cb5-65ac-4040-a2e7-0bdac47dd18e response_code = 200 uri = /vpc-routes
17812024-11-16T00:48:27.590ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
17822024-11-16T00:48:27.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55083 req_id = a40f4546-1bf1-40be-9c5f-65aaa97b0829 response_code = 204 uri = /eip-gateways
17832024-11-16T00:48:27.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55083 req_id = 3df1c6e9-74f3-4d85-93f4-37c549d6747b response_code = 204 uri = /vpc-routes
17842024-11-16T00:48:27.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59169
17852024-11-16T00:48:27.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59169 req_id = 2b31deeb-0c6b-41e9-b549-9c1c396d9ce8 response_code = 200 uri = /v2p
17862024-11-16T00:48:27.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61254
17872024-11-16T00:48:27.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61254 req_id = bf351c4d-f046-4567-ba1d-212ea20e67e2 response_code = 200 uri = /v2p
17882024-11-16T00:48:27.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65232
17892024-11-16T00:48:27.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65232 req_id = 2a2a3039-4787-4537-8731-9435fdc4d022 response_code = 200 uri = /vpc-routes
17902024-11-16T00:48:27.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44071
17912024-11-16T00:48:27.693ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17922024-11-16T00:48:27.731ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17932024-11-16T00:48:27.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93958 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44071 req_id = 0ea29440-7753-43f7-9ab0-710f9c76559e response_code = 204 uri = /switch-ports
17942024-11-16T00:48:27.787ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
17952024-11-16T00:48:27.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60206
17962024-11-16T00:48:27.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65232 req_id = 957931cd-64d6-4d6b-abe0-289dc54e4aa2 response_code = 204 uri = /eip-gateways
17972024-11-16T00:48:27.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44071 req_id = 5ca29e67-a642-4a63-a8d6-f95adca1c350 response_code = 200 uri = /network-bootstore-config
17982024-11-16T00:48:27.788ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17992024-11-16T00:48:27.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65232 req_id = b9b78f01-ad81-417b-a59f-3ef4ad87c59a response_code = 204 uri = /vpc-routes
18002024-11-16T00:48:27.824ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18012024-11-16T00:48:27.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89486 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60206 req_id = d3e96868-24ae-40a3-8b12-3480f9668e25 response_code = 204 uri = /switch-ports
18022024-11-16T00:48:27.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60206 req_id = 8933a003-dd80-4e1f-90bc-8193e18c7617 response_code = 200 uri = /network-bootstore-config
18032024-11-16T00:48:29.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37494
18042024-11-16T00:48:29.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37494 req_id = 11158120-9a60-41a9-b7d8-8975c96e5d03 response_code = 200 uri = /vpc-routes
18052024-11-16T00:48:29.813ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
18062024-11-16T00:48:29.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37494 req_id = 938e682c-69a9-4db9-a601-e5802f44ef1f response_code = 204 uri = /eip-gateways
18072024-11-16T00:48:29.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37494 req_id = 13ff6de0-ec95-4065-b683-6bdc0be3f5e5 response_code = 204 uri = /vpc-routes
18082024-11-16T00:48:29.929ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52576
18092024-11-16T00:48:29.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52576 req_id = 0c600c67-1eb8-415f-b087-e34a5de210ed response_code = 200 uri = /v2p
18102024-11-16T00:48:29.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51757
18112024-11-16T00:48:29.954ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18122024-11-16T00:48:29.988ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18132024-11-16T00:48:30.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90808 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51757 req_id = ed24cec3-ddee-40ac-94b9-9815115a5613 response_code = 204 uri = /switch-ports
18142024-11-16T00:48:30.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51757 req_id = 8f5a137b-d8fd-48b5-a305-dcae669ffa3a response_code = 200 uri = /network-bootstore-config
18152024-11-16T00:48:43.214ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46024
18162024-11-16T00:48:43.214ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46024 req_id = 9a5599aa-76f3-4422-a028-b4378bebeba9 response_code = 200 uri = /baseboard
18172024-11-16T00:48:57.674ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32854
18182024-11-16T00:48:57.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32854 req_id = 51baf7a2-5a32-4cc3-bae9-9011f5a863e1 response_code = 200 uri = /vpc-routes
18192024-11-16T00:48:57.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45684
18202024-11-16T00:48:57.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45684 req_id = b0e9ec04-5788-4362-b45c-6897f8a3e420 response_code = 200 uri = /vpc-routes
18212024-11-16T00:48:57.724ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
18222024-11-16T00:48:57.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32854 req_id = 78af6e8a-4085-44db-9f5b-c8f488b568a6 response_code = 204 uri = /eip-gateways
18232024-11-16T00:48:57.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32854 req_id = a29e8e72-3f51-43fd-be0f-65884d9d4b39 response_code = 204 uri = /vpc-routes
18242024-11-16T00:48:57.748ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
18252024-11-16T00:48:57.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45684 req_id = eed70f8b-1473-48e6-860a-ecee5b6c1188 response_code = 204 uri = /eip-gateways
18262024-11-16T00:48:57.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60482
18272024-11-16T00:48:57.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60482 req_id = 8d292358-1f15-4170-bf9c-446de556dacf response_code = 200 uri = /v2p
18282024-11-16T00:48:57.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45684 req_id = b59d238b-8a28-4dd8-a883-64151f3729d6 response_code = 204 uri = /vpc-routes
18292024-11-16T00:48:57.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40420
18302024-11-16T00:48:57.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40420 req_id = 25994157-0f57-4c39-a822-fcb1ede8b5ee response_code = 200 uri = /v2p
18312024-11-16T00:48:57.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36951
18322024-11-16T00:48:57.831ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18332024-11-16T00:48:57.869ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18342024-11-16T00:48:57.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91382 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36951 req_id = cf2ce22f-67dd-4593-944b-77b04a3ecc7b response_code = 204 uri = /switch-ports
18352024-11-16T00:48:57.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36951 req_id = 9dcf2d7c-4f0e-4c3e-b9b7-ce6c6c58786d response_code = 200 uri = /network-bootstore-config
18362024-11-16T00:48:57.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59481
18372024-11-16T00:48:57.967ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18382024-11-16T00:48:58.000ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18392024-11-16T00:48:58.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85157 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59481 req_id = a5cbad84-1e51-4d4d-9077-d7add15a730e response_code = 204 uri = /switch-ports
18402024-11-16T00:48:58.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59481 req_id = 72ccf98d-b669-445b-a3b4-ba1e289eb827 response_code = 200 uri = /network-bootstore-config
18412024-11-16T00:48:59.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48149
18422024-11-16T00:48:59.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48149 req_id = 5c6f37c4-074f-4391-ac31-091bd5089725 response_code = 200 uri = /vpc-routes
18432024-11-16T00:48:59.915ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
18442024-11-16T00:48:59.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48149 req_id = e0375b4e-87a0-40bb-8eb2-9344cb430946 response_code = 204 uri = /eip-gateways
18452024-11-16T00:48:59.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48149 req_id = eb64d1af-cd8a-4c1c-b945-abc0ad784e47 response_code = 204 uri = /vpc-routes
18462024-11-16T00:48:59.997ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48544
18472024-11-16T00:48:59.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48544 req_id = 02536e16-f00e-44c0-a93d-ac6d5a3e82ff response_code = 200 uri = /v2p
18482024-11-16T00:49:00.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61648
18492024-11-16T00:49:00.074ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18502024-11-16T00:49:00.109ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18512024-11-16T00:49:00.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86597 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61648 req_id = 299ebfa4-fa60-4d60-8b97-5ba2529d406a response_code = 204 uri = /switch-ports
18522024-11-16T00:49:00.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61648 req_id = 60f2560d-3c4b-47d0-98bf-537062cc23ca response_code = 200 uri = /network-bootstore-config
18532024-11-16T00:49:13.247ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65133
18542024-11-16T00:49:13.247ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65133 req_id = 2aedcc9e-44e1-4828-a07f-5d920d87d8d9 response_code = 200 uri = /baseboard
18552024-11-16T00:49:27.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61640
18562024-11-16T00:49:27.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61640 req_id = eff81691-ebff-43a2-9b3d-fd93d5953674 response_code = 200 uri = /vpc-routes
18572024-11-16T00:49:27.620ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
18582024-11-16T00:49:27.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61640 req_id = 257a0ca6-30d4-4f1e-b696-3d0225aef7b6 response_code = 204 uri = /eip-gateways
18592024-11-16T00:49:27.634ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63291
18602024-11-16T00:49:27.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63291 req_id = 3881510f-c4a8-45c3-a42c-8a57f4c2d3d5 response_code = 200 uri = /vpc-routes
18612024-11-16T00:49:27.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41645
18622024-11-16T00:49:27.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41645 req_id = 3b2d1a10-bda2-454b-a8d5-01f6f16697c0 response_code = 200 uri = /v2p
18632024-11-16T00:49:27.639ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58724
18642024-11-16T00:49:27.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58724 req_id = 362f0daa-7834-4dae-bec6-b2ba0b298b36 response_code = 200 uri = /v2p
18652024-11-16T00:49:27.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61640 req_id = 3dc19261-e23b-4db2-b7cd-9487fb0bdc60 response_code = 204 uri = /vpc-routes
18662024-11-16T00:49:27.680ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
18672024-11-16T00:49:27.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63291 req_id = e5eeca79-ea87-4ea3-ba56-73b0d3debbd0 response_code = 204 uri = /eip-gateways
18682024-11-16T00:49:27.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63291 req_id = 19064b2d-5a2b-4b10-b563-64eb0a1ae5a8 response_code = 204 uri = /vpc-routes
18692024-11-16T00:49:27.709ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37487
18702024-11-16T00:49:27.709ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18712024-11-16T00:49:27.746ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18722024-11-16T00:49:27.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92284 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37487 req_id = c7c058b2-553e-4183-b761-e482f4f9fdca response_code = 204 uri = /switch-ports
18732024-11-16T00:49:27.801ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36516
18742024-11-16T00:49:27.801ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18752024-11-16T00:49:27.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3595 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37487 req_id = f3fa02bb-b025-412f-8511-120d24f9f3cc response_code = 200 uri = /network-bootstore-config
18762024-11-16T00:49:27.835ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18772024-11-16T00:49:27.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84789 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36516 req_id = f9ac27ee-4e1d-48a5-852c-72892f449a49 response_code = 204 uri = /switch-ports
18782024-11-16T00:49:27.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36516 req_id = cce96090-164c-4533-8b54-a594d2d91ce3 response_code = 200 uri = /network-bootstore-config
18792024-11-16T00:49:29.691ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47919
18802024-11-16T00:49:29.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47919 req_id = 25a8dfc3-5083-4630-82e5-f77d623c6505 response_code = 200 uri = /vpc-routes
18812024-11-16T00:49:29.735ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
18822024-11-16T00:49:29.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47919 req_id = 2774ec9f-2ab6-4f1f-b7df-4976260f29a9 response_code = 204 uri = /eip-gateways
18832024-11-16T00:49:29.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47919 req_id = 77dc8afe-dafd-41df-b932-a5a43e34ccd9 response_code = 204 uri = /vpc-routes
18842024-11-16T00:49:29.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58577
18852024-11-16T00:49:29.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58577 req_id = 57d839fa-1797-45da-bbf6-633b569d615f response_code = 200 uri = /v2p
18862024-11-16T00:49:29.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40640
18872024-11-16T00:49:29.787ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18882024-11-16T00:49:29.825ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18892024-11-16T00:49:29.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91511 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40640 req_id = d632fb5c-4899-4785-aae6-e170b49236ce response_code = 204 uri = /switch-ports
18902024-11-16T00:49:29.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40640 req_id = 08dadd7b-09f2-4539-8eb7-189013b9e2ac response_code = 200 uri = /network-bootstore-config
18912024-11-16T00:49:43.280ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53009
18922024-11-16T00:49:43.280ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53009 req_id = 71e4d417-0819-43a1-9fcf-1a59d39197d0 response_code = 200 uri = /baseboard
18932024-11-16T00:49:52.041ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
18942024-11-16T00:49:57.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46444
18952024-11-16T00:49:57.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46444 req_id = ff03cc30-e697-40ee-ab88-f3c2183cd24a response_code = 200 uri = /vpc-routes
18962024-11-16T00:49:57.676ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
18972024-11-16T00:49:57.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46444 req_id = 409dc4ca-4124-490c-bd70-4096350e07bd response_code = 204 uri = /eip-gateways
18982024-11-16T00:49:57.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46444 req_id = 73e326b7-605d-4274-871d-b20d883ffe1d response_code = 204 uri = /vpc-routes
18992024-11-16T00:49:57.846ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43879
19002024-11-16T00:49:57.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43879 req_id = 10148369-b956-425f-927b-25a472b43599 response_code = 200 uri = /vpc-routes
19012024-11-16T00:49:57.898ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
19022024-11-16T00:49:57.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43879 req_id = eb5632c4-1b24-4a8f-8d15-ade70cceaded response_code = 204 uri = /eip-gateways
19032024-11-16T00:49:57.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64225
19042024-11-16T00:49:57.902ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19052024-11-16T00:49:57.940ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19062024-11-16T00:49:57.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92209 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64225 req_id = 8bd4231d-2404-49ce-8c3f-ab4604223845 response_code = 204 uri = /switch-ports
19072024-11-16T00:49:57.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51146
19082024-11-16T00:49:57.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34829
19092024-11-16T00:49:57.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61359
19102024-11-16T00:49:57.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 333 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64225 req_id = fdda7370-674b-4cc3-a503-0bc6d609b1cb response_code = 200 uri = /network-bootstore-config
19112024-11-16T00:49:57.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61359 req_id = dce9f72a-17f8-4826-940b-04c923720032 response_code = 200 uri = /v2p
19122024-11-16T00:49:57.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 458 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43879 req_id = 9ff7c5f5-9cd2-490d-87c9-e112b0de2d24 response_code = 204 uri = /vpc-routes
19132024-11-16T00:49:57.995ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19142024-11-16T00:49:57.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51146 req_id = acf27b09-62a8-4dcf-8c91-c95f0118ed9b response_code = 200 uri = /v2p
19152024-11-16T00:49:58.031ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19162024-11-16T00:49:58.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86858 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34829 req_id = 807635a6-42cd-4e55-90a2-ca35e2e7591c response_code = 204 uri = /switch-ports
19172024-11-16T00:49:58.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34829 req_id = bedc67f9-92e2-4eea-9f64-6b910f2bb099 response_code = 200 uri = /network-bootstore-config
19182024-11-16T00:49:59.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40591
19192024-11-16T00:49:59.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40591 req_id = 6b8f0516-0202-4f47-a3ea-0626a7b6beba response_code = 200 uri = /vpc-routes
19202024-11-16T00:49:59.843ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
19212024-11-16T00:49:59.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40591 req_id = 0a3e3d99-c2d3-4203-9f86-c64680def1ca response_code = 204 uri = /eip-gateways
19222024-11-16T00:49:59.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40591 req_id = 6338b716-9c04-4154-a55c-ad2e36807c19 response_code = 204 uri = /vpc-routes
19232024-11-16T00:50:00.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57420
19242024-11-16T00:50:00.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57420 req_id = f3a52c08-35cc-48ab-85ab-1744b82f890c response_code = 200 uri = /v2p
19252024-11-16T00:50:00.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61002
19262024-11-16T00:50:00.123ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19272024-11-16T00:50:00.160ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19282024-11-16T00:50:00.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89438 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61002 req_id = c737b58c-06f6-437e-ad13-ba8c388a25fe response_code = 204 uri = /switch-ports
19292024-11-16T00:50:00.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61002 req_id = 717d845d-f47d-4c8f-a45a-ec635c80ea12 response_code = 200 uri = /network-bootstore-config
19302024-11-16T00:50:13.315ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51412
19312024-11-16T00:50:13.316ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51412 req_id = d0459cbb-5a20-4264-a41f-987b1e4ca994 response_code = 200 uri = /baseboard
19322024-11-16T00:50:27.589ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51265
19332024-11-16T00:50:27.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51265 req_id = 2da0db67-1b3f-477a-8366-e517e15133d5 response_code = 200 uri = /vpc-routes
19342024-11-16T00:50:27.673ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
19352024-11-16T00:50:27.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51265 req_id = 97d1800d-8b25-43c9-afc7-f6d581d9bda4 response_code = 204 uri = /eip-gateways
19362024-11-16T00:50:27.713ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44175
19372024-11-16T00:50:27.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44175 req_id = de04c766-6255-4729-89de-b039e7f4ce7a response_code = 200 uri = /vpc-routes
19382024-11-16T00:50:27.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57995
19392024-11-16T00:50:27.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57995 req_id = 2dd58bf6-23c2-45a7-9bf2-61ffdc54188b response_code = 200 uri = /v2p
19402024-11-16T00:50:27.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51265 req_id = 77fc885a-f440-4d0a-98e9-2c27b9bc34ff response_code = 204 uri = /vpc-routes
19412024-11-16T00:50:27.728ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
19422024-11-16T00:50:27.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44175 req_id = ad5e79b2-ef3c-44fc-8b63-57b25b3b3698 response_code = 204 uri = /eip-gateways
19432024-11-16T00:50:27.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44175 req_id = fd25a683-d9f6-4866-9629-df048df13af8 response_code = 204 uri = /vpc-routes
19442024-11-16T00:50:27.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46489
19452024-11-16T00:50:27.758ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19462024-11-16T00:50:27.796ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19472024-11-16T00:50:27.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94766 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46489 req_id = 4b1c940d-c1df-46bc-903f-df0555c25300 response_code = 204 uri = /switch-ports
19482024-11-16T00:50:27.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46489 req_id = c2120a3e-e721-4e31-84b0-eec5d487c667 response_code = 200 uri = /network-bootstore-config
19492024-11-16T00:50:27.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40200
19502024-11-16T00:50:27.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40200 req_id = 3885d396-9e14-4d5a-b352-a5cd8ef5e2e4 response_code = 200 uri = /v2p
19512024-11-16T00:50:27.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35886
19522024-11-16T00:50:27.902ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19532024-11-16T00:50:27.940ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19542024-11-16T00:50:27.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92759 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35886 req_id = 1f12fe79-d78f-43af-9dca-0895b74368f5 response_code = 204 uri = /switch-ports
19552024-11-16T00:50:27.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35886 req_id = 1865b3ed-55b0-4b79-923b-78d725246631 response_code = 200 uri = /network-bootstore-config
19562024-11-16T00:50:29.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49475
19572024-11-16T00:50:29.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49475 req_id = a8afb011-b0a5-49e6-811a-829ba6bf7832 response_code = 200 uri = /vpc-routes
19582024-11-16T00:50:29.726ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
19592024-11-16T00:50:29.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49475 req_id = 2b647b07-afe8-4211-a266-a8fa9a252dea response_code = 204 uri = /eip-gateways
19602024-11-16T00:50:29.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49475 req_id = 9b47caec-30f1-4674-b76a-6322a79c3dec response_code = 204 uri = /vpc-routes
19612024-11-16T00:50:29.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40479
19622024-11-16T00:50:29.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40479 req_id = 53872ca6-5006-435a-9269-9d4b9a7d681b response_code = 200 uri = /v2p
19632024-11-16T00:50:29.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36219
19642024-11-16T00:50:29.792ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19652024-11-16T00:50:29.828ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19662024-11-16T00:50:29.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92288 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36219 req_id = 69306081-36ae-4469-bb8c-89132fb25c30 response_code = 204 uri = /switch-ports
19672024-11-16T00:50:29.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36219 req_id = 6416bb91-1268-46ac-baec-9fd2bf806f19 response_code = 200 uri = /network-bootstore-config
19682024-11-16T00:50:43.349ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35170
19692024-11-16T00:50:43.349ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35170 req_id = 7b18dda9-4638-4a63-a74d-078ad1a291f2 response_code = 200 uri = /baseboard
19702024-11-16T00:50:57.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42327
19712024-11-16T00:50:57.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42327 req_id = 3b09e8a3-2981-41aa-a860-841015231545 response_code = 200 uri = /vpc-routes
19722024-11-16T00:50:57.772ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
19732024-11-16T00:50:57.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42327 req_id = 7d06840a-6327-4f6b-9cd3-0c240f0e03e0 response_code = 204 uri = /eip-gateways
19742024-11-16T00:50:57.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42327 req_id = ca019890-3f53-4898-8bc7-2c77f2fef340 response_code = 204 uri = /vpc-routes
19752024-11-16T00:50:57.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58428
19762024-11-16T00:50:57.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58428 req_id = 319f6b87-2bde-4d11-adcb-ffb48bf41ee4 response_code = 200 uri = /vpc-routes
19772024-11-16T00:50:57.839ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
19782024-11-16T00:50:57.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58428 req_id = fcf82f20-f1ca-4ad6-8d4a-6063be53d73d response_code = 204 uri = /eip-gateways
19792024-11-16T00:50:57.845ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43858
19802024-11-16T00:50:57.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43858 req_id = 76f23320-8920-4b7c-8068-5c60a8c54834 response_code = 200 uri = /v2p
19812024-11-16T00:50:57.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58428 req_id = 0a2144b9-0c0f-484c-890c-cc92cd921a8e response_code = 204 uri = /vpc-routes
19822024-11-16T00:50:57.864ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44806
19832024-11-16T00:50:57.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44806 req_id = cdc30604-ae72-4aa6-ba52-27ae79333613 response_code = 200 uri = /v2p
19842024-11-16T00:50:57.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50092
19852024-11-16T00:50:57.876ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19862024-11-16T00:50:57.910ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19872024-11-16T00:50:57.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88027 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50092 req_id = 39bab521-7f33-4732-b3c6-401361f4eb95 response_code = 204 uri = /switch-ports
19882024-11-16T00:50:57.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50092 req_id = 71ecef53-46c5-4cd4-8790-b583f9b9f884 response_code = 200 uri = /network-bootstore-config
19892024-11-16T00:50:57.977ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58998
19902024-11-16T00:50:57.977ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19912024-11-16T00:50:58.010ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19922024-11-16T00:50:58.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85267 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58998 req_id = c4e6e4b3-a430-4385-9e92-4fdd83548594 response_code = 204 uri = /switch-ports
19932024-11-16T00:50:58.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58998 req_id = e4a8a268-c064-45ed-a688-ecfba12b6b56 response_code = 200 uri = /network-bootstore-config
19942024-11-16T00:50:59.820ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46025
19952024-11-16T00:50:59.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46025 req_id = db416453-04ff-41a9-9b46-35fa232536fc response_code = 200 uri = /vpc-routes
19962024-11-16T00:50:59.885ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
19972024-11-16T00:50:59.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46025 req_id = 6898cfdb-f55f-4cc1-8425-e52717125331 response_code = 204 uri = /eip-gateways
19982024-11-16T00:50:59.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46025 req_id = 10de460c-4fca-4d40-8e61-c435f78bc542 response_code = 204 uri = /vpc-routes
19992024-11-16T00:50:59.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35229
20002024-11-16T00:50:59.971ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20012024-11-16T00:51:00.012ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20022024-11-16T00:51:00.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100867 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35229 req_id = 71eb4dea-8565-4c13-b94e-9c78fed2b210 response_code = 204 uri = /switch-ports
20032024-11-16T00:51:00.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33664
20042024-11-16T00:51:00.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33664 req_id = c32ad095-bf24-44c9-b2ef-bbda0756ce81 response_code = 200 uri = /v2p
20052024-11-16T00:51:00.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35229 req_id = 7d0f8836-7291-45ce-bf30-8a73c37990bf response_code = 200 uri = /network-bootstore-config
20062024-11-16T00:51:13.380ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34154
20072024-11-16T00:51:13.381ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34154 req_id = 20343a87-5747-4e63-a666-49c0812a2264 response_code = 200 uri = /baseboard
20082024-11-16T00:51:27.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47146
20092024-11-16T00:51:27.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47146 req_id = 42d05368-eff6-43e5-bf98-1895c3d6e738 response_code = 200 uri = /vpc-routes
20102024-11-16T00:51:27.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51630
20112024-11-16T00:51:27.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 23 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51630 req_id = a9406d37-8af9-4cc3-9ef6-c003244e38fc response_code = 200 uri = /vpc-routes
20122024-11-16T00:51:27.533ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
20132024-11-16T00:51:27.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47146 req_id = 9d83252c-43c8-466d-a5a9-21d9aaa1c2c8 response_code = 204 uri = /eip-gateways
20142024-11-16T00:51:27.535ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
20152024-11-16T00:51:27.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51630 req_id = 35eba7d7-b38c-4c0c-9a42-0a19c5a2cb0f response_code = 204 uri = /eip-gateways
20162024-11-16T00:51:27.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47146 req_id = 327a8160-50a9-40ee-b20d-93ca1d45f30d response_code = 204 uri = /vpc-routes
20172024-11-16T00:51:27.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51630 req_id = 46ab930b-460d-415c-bf47-077a8df0a956 response_code = 204 uri = /vpc-routes
20182024-11-16T00:51:27.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48220
20192024-11-16T00:51:27.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48220 req_id = 9380db48-b71a-4bcc-a8c1-edb42b99f3aa response_code = 200 uri = /v2p
20202024-11-16T00:51:27.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41685
20212024-11-16T00:51:27.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41685 req_id = 0f820b79-9538-42b8-823a-35fa0db4f4ca response_code = 200 uri = /v2p
20222024-11-16T00:51:27.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35214
20232024-11-16T00:51:27.610ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20242024-11-16T00:51:27.649ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20252024-11-16T00:51:27.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95570 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35214 req_id = 923dc6e6-a5c9-485d-b800-295b02652101 response_code = 204 uri = /switch-ports
20262024-11-16T00:51:27.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48899
20272024-11-16T00:51:27.705ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20282024-11-16T00:51:27.740ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20292024-11-16T00:51:27.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86937 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48899 req_id = f868e074-4739-42ac-b85b-94b4039afe50 response_code = 204 uri = /switch-ports
20302024-11-16T00:51:27.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35214 req_id = e32eabd7-02c6-4dfc-bc96-3a0d1efb42df response_code = 200 uri = /network-bootstore-config
20312024-11-16T00:51:27.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48899 req_id = 6d2ef4c8-3401-4454-a63b-e13e94cb59d1 response_code = 200 uri = /network-bootstore-config
20322024-11-16T00:51:29.709ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61886
20332024-11-16T00:51:29.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61886 req_id = 48c5952e-7672-4a96-bbf6-157ee3400f9d response_code = 200 uri = /vpc-routes
20342024-11-16T00:51:29.756ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
20352024-11-16T00:51:29.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61886 req_id = 0d9773ad-ed88-4d1e-89bc-c8479d36fa83 response_code = 204 uri = /eip-gateways
20362024-11-16T00:51:29.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55783
20372024-11-16T00:51:29.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55783 req_id = f242c08f-e20a-4ebd-aed5-6b2f0f5ba48b response_code = 200 uri = /v2p
20382024-11-16T00:51:29.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61886 req_id = 71f22972-8d18-4c72-ae2e-f2b56753376a response_code = 204 uri = /vpc-routes
20392024-11-16T00:51:29.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45626
20402024-11-16T00:51:29.789ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20412024-11-16T00:51:29.825ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20422024-11-16T00:51:29.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90743 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45626 req_id = 20de62bc-bb5c-4f1d-b3ef-2df67cb01024 response_code = 204 uri = /switch-ports
20432024-11-16T00:51:29.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45626 req_id = fbce465a-3eec-48a9-bbed-ca16ad310e05 response_code = 200 uri = /network-bootstore-config
20442024-11-16T00:51:43.413ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60827
20452024-11-16T00:51:43.413ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60827 req_id = 855b7995-68b3-47df-828e-80cd3b4bb537 response_code = 200 uri = /baseboard
20462024-11-16T00:51:57.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57019
20472024-11-16T00:51:57.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57019 req_id = 71ac7b5c-d452-484b-ae22-131ea142b808 response_code = 200 uri = /vpc-routes
20482024-11-16T00:51:57.728ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
20492024-11-16T00:51:57.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57019 req_id = 5db5090d-f017-4eb8-b573-67519b85a6c3 response_code = 204 uri = /eip-gateways
20502024-11-16T00:51:57.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57019 req_id = 44e37080-0450-4ca6-b54d-f52900aebb28 response_code = 204 uri = /vpc-routes
20512024-11-16T00:51:57.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46219
20522024-11-16T00:51:57.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46219 req_id = a911eb82-ed3e-4192-a579-ee2ff42c1f1f response_code = 200 uri = /v2p
20532024-11-16T00:51:57.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58477
20542024-11-16T00:51:57.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58477 req_id = 3a01870d-4905-45f9-bf10-f21309156b6a response_code = 200 uri = /vpc-routes
20552024-11-16T00:51:57.809ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35464
20562024-11-16T00:51:57.809ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20572024-11-16T00:51:57.852ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20582024-11-16T00:51:57.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109434 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35464 req_id = dc1c291b-6077-4714-a34d-cb4beaa70633 response_code = 204 uri = /switch-ports
20592024-11-16T00:51:57.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35149
20602024-11-16T00:51:57.919ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
20612024-11-16T00:51:57.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58477 req_id = 2e4556d6-3d1f-4d50-b9be-565e5349173c response_code = 204 uri = /eip-gateways
20622024-11-16T00:51:57.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48230
20632024-11-16T00:51:57.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35464 req_id = 2cf2c3cb-522a-47c6-bfb3-910711bc9d9b response_code = 200 uri = /network-bootstore-config
20642024-11-16T00:51:57.919ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20652024-11-16T00:51:57.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4931 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48230 req_id = 246a4834-17cf-4a48-97cd-1a52208582e7 response_code = 200 uri = /v2p
20662024-11-16T00:51:57.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58477 req_id = e07f28c7-e345-41c9-a755-e77212f2628a response_code = 204 uri = /vpc-routes
20672024-11-16T00:51:57.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38153
20682024-11-16T00:51:57.948ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 590b90e0-533a-4c8d-9965-a74bed460cd8, kind: Service { id: 3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888 }, name: Name("external-dns-3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 11])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 729e6010-0a28-4302-8831-f6612b85a78f, kind: Service { id: 4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf }, name: Name("external-dns-4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4c60317e-983a-4ac6-8708-96d944c78888, kind: Service { id: 6d7cf1e6-3ed9-42bc-8f17-49159affac6b }, name: Name("nexus-6d7cf1e6-3ed9-42bc-8f17-49159affac6b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 86c67e2b-8c46-4e16-8253-9de9bc79f0fa, kind: Service { id: cebce92a-579a-4295-b410-4ce799c5bf29 }, name: Name("nexus-cebce92a-579a-4295-b410-4ce799c5bf29"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa85ba01-9643-4c9d-8080-62de967b5b63, kind: Service { id: ff27fc99-a5d9-4c14-972a-fc3b1a67eb96 }, name: Name("nexus-ff27fc99-a5d9-4c14-972a-fc3b1a67eb96"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 158])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20692024-11-16T00:51:57.948ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20702024-11-16T00:51:57.948ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20712024-11-16T00:51:57.948ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20722024-11-16T00:51:57.949ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20732024-11-16T00:51:57.949ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
20742024-11-16T00:51:57.949ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20752024-11-16T00:51:57.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 555 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38153 req_id = c98492a9-738e-4d67-8923-81a64361acfa response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20762024-11-16T00:51:57.956ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20772024-11-16T00:51:58.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94786 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35149 req_id = 3c80ba5d-736d-4192-bd1d-eb87889cf2b7 response_code = 204 uri = /switch-ports
20782024-11-16T00:51:58.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35149 req_id = 968e241c-e1d6-4e25-8a95-61c0089adf1d response_code = 200 uri = /network-bootstore-config
20792024-11-16T00:51:58.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60893
20802024-11-16T00:51:58.117ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 590b90e0-533a-4c8d-9965-a74bed460cd8, kind: Service { id: 3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888 }, name: Name("external-dns-3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 11])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 729e6010-0a28-4302-8831-f6612b85a78f, kind: Service { id: 4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf }, name: Name("external-dns-4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4c60317e-983a-4ac6-8708-96d944c78888, kind: Service { id: 6d7cf1e6-3ed9-42bc-8f17-49159affac6b }, name: Name("nexus-6d7cf1e6-3ed9-42bc-8f17-49159affac6b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 86c67e2b-8c46-4e16-8253-9de9bc79f0fa, kind: Service { id: cebce92a-579a-4295-b410-4ce799c5bf29 }, name: Name("nexus-cebce92a-579a-4295-b410-4ce799c5bf29"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa85ba01-9643-4c9d-8080-62de967b5b63, kind: Service { id: ff27fc99-a5d9-4c14-972a-fc3b1a67eb96 }, name: Name("nexus-ff27fc99-a5d9-4c14-972a-fc3b1a67eb96"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 158])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20812024-11-16T00:51:58.117ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20822024-11-16T00:51:58.118ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20832024-11-16T00:51:58.118ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20842024-11-16T00:51:58.118ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20852024-11-16T00:51:58.118ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
20862024-11-16T00:51:58.118ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20872024-11-16T00:51:58.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 353 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60893 req_id = 2f6d1b13-a0c9-4a65-917b-e46ef61889a2 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20882024-11-16T00:51:59.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58144
20892024-11-16T00:51:59.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58144 req_id = b97af8ec-24fe-467e-834d-cfa09025d745 response_code = 200 uri = /vpc-routes
20902024-11-16T00:51:59.807ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
20912024-11-16T00:51:59.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58144 req_id = dedf5d43-6b3f-48a4-9e87-a5f83effcb60 response_code = 204 uri = /eip-gateways
20922024-11-16T00:51:59.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58144 req_id = 757076b2-8cd7-4db2-93d0-1b14fbe8d504 response_code = 204 uri = /vpc-routes
20932024-11-16T00:52:00.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46540
20942024-11-16T00:52:00.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46540 req_id = ccf11872-4597-4c8a-be9d-e74fbda2fd4c response_code = 200 uri = /v2p
20952024-11-16T00:52:00.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44433
20962024-11-16T00:52:00.081ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 590b90e0-533a-4c8d-9965-a74bed460cd8, kind: Service { id: 3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888 }, name: Name("external-dns-3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 11])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 729e6010-0a28-4302-8831-f6612b85a78f, kind: Service { id: 4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf }, name: Name("external-dns-4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4c60317e-983a-4ac6-8708-96d944c78888, kind: Service { id: 6d7cf1e6-3ed9-42bc-8f17-49159affac6b }, name: Name("nexus-6d7cf1e6-3ed9-42bc-8f17-49159affac6b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 86c67e2b-8c46-4e16-8253-9de9bc79f0fa, kind: Service { id: cebce92a-579a-4295-b410-4ce799c5bf29 }, name: Name("nexus-cebce92a-579a-4295-b410-4ce799c5bf29"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa85ba01-9643-4c9d-8080-62de967b5b63, kind: Service { id: ff27fc99-a5d9-4c14-972a-fc3b1a67eb96 }, name: Name("nexus-ff27fc99-a5d9-4c14-972a-fc3b1a67eb96"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 158])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20972024-11-16T00:52:00.081ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20982024-11-16T00:52:00.081ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20992024-11-16T00:52:00.081ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21002024-11-16T00:52:00.081ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21012024-11-16T00:52:00.081ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
21022024-11-16T00:52:00.081ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21032024-11-16T00:52:00.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44433 req_id = 5ba5f657-fa02-4b34-b4c5-bfb3407f2239 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21042024-11-16T00:52:00.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56533
21052024-11-16T00:52:00.129ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21062024-11-16T00:52:00.163ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21072024-11-16T00:52:00.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86459 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56533 req_id = 328e2680-c951-4d1d-a6d4-410ee3ca235a response_code = 204 uri = /switch-ports
21082024-11-16T00:52:00.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56533 req_id = 9ccd40a1-6b6d-4a20-8a15-adfb8fd64889 response_code = 200 uri = /network-bootstore-config
21092024-11-16T00:52:13.443ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43390
21102024-11-16T00:52:13.443ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43390 req_id = e62391f7-b720-41f8-8996-fc44db04f9c4 response_code = 200 uri = /baseboard
21112024-11-16T00:52:27.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36411
21122024-11-16T00:52:27.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36411 req_id = 801587e3-dfa3-42a5-ba8f-97865fb0e7bd response_code = 200 uri = /vpc-routes
21132024-11-16T00:52:27.531ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53711
21142024-11-16T00:52:27.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53711 req_id = 83ba43ce-80d7-4556-bf84-03a78713ef84 response_code = 200 uri = /vpc-routes
21152024-11-16T00:52:27.580ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
21162024-11-16T00:52:27.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53711 req_id = 1cea74c1-6d8d-4306-bca1-9447e5a1c0f4 response_code = 204 uri = /eip-gateways
21172024-11-16T00:52:27.581ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
21182024-11-16T00:52:27.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36411 req_id = f783c719-d279-4888-ab21-5745596bd343 response_code = 204 uri = /eip-gateways
21192024-11-16T00:52:27.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53711 req_id = 853b6ed8-f5f7-4739-ba09-43234f80ea7b response_code = 204 uri = /vpc-routes
21202024-11-16T00:52:27.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36411 req_id = d2f08b46-f26c-44b6-8345-e2536f5ccf65 response_code = 204 uri = /vpc-routes
21212024-11-16T00:52:27.611ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32924
21222024-11-16T00:52:27.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32924 req_id = 8d8f5780-4286-4708-b728-6bb681d510c7 response_code = 200 uri = /v2p
21232024-11-16T00:52:27.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36279
21242024-11-16T00:52:27.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36279 req_id = 123e413b-978e-4401-b919-b429a3cb9966 response_code = 200 uri = /v2p
21252024-11-16T00:52:27.678ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34058
21262024-11-16T00:52:27.678ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21272024-11-16T00:52:27.716ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21282024-11-16T00:52:27.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97235 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34058 req_id = 1be809ef-105f-405e-828e-8e1ca4da40df response_code = 204 uri = /switch-ports
21292024-11-16T00:52:27.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48839
21302024-11-16T00:52:27.775ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21312024-11-16T00:52:27.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4037 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34058 req_id = 045ca04f-b8c7-4973-aceb-013887ef035e response_code = 200 uri = /network-bootstore-config
21322024-11-16T00:52:27.810ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21332024-11-16T00:52:27.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91679 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48839 req_id = 445bcc37-05fa-4fe7-890d-2f30a9f86edd response_code = 204 uri = /switch-ports
21342024-11-16T00:52:27.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48839 req_id = bec516f5-c32b-4811-b22f-6188312d4272 response_code = 200 uri = /network-bootstore-config
21352024-11-16T00:52:29.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43740
21362024-11-16T00:52:29.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43740 req_id = bd71835c-e1d7-43bd-b8e9-69e9370e7bf2 response_code = 200 uri = /vpc-routes
21372024-11-16T00:52:29.651ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
21382024-11-16T00:52:29.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43740 req_id = 79f5ca7f-866c-42fe-959f-06f85f3d69ea response_code = 204 uri = /eip-gateways
21392024-11-16T00:52:29.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43740 req_id = 8d19ab16-8b3b-486a-b62b-cf5f3fb59cfd response_code = 204 uri = /vpc-routes
21402024-11-16T00:52:29.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59357
21412024-11-16T00:52:29.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59357 req_id = 99e8635d-b0ec-4d36-95b0-41bbadb5c4e5 response_code = 200 uri = /v2p
21422024-11-16T00:52:29.809ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49313
21432024-11-16T00:52:29.809ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21442024-11-16T00:52:29.848ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21452024-11-16T00:52:29.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92269 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49313 req_id = 19d3b961-0f6a-40f9-84c6-8e27bc140519 response_code = 204 uri = /switch-ports
21462024-11-16T00:52:29.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49313 req_id = 18093650-c31e-40e4-9a27-80b4cadd91d8 response_code = 200 uri = /network-bootstore-config
21472024-11-16T00:52:43.477ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56901
21482024-11-16T00:52:43.478ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56901 req_id = 0f01b3d6-52ff-43d7-a823-08aa9938c1fe response_code = 200 uri = /baseboard
21492024-11-16T00:52:57.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56578
21502024-11-16T00:52:57.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56578 req_id = 02a16942-038b-4124-8561-fc46d27efd14 response_code = 200 uri = /vpc-routes
21512024-11-16T00:52:57.708ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
21522024-11-16T00:52:57.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56578 req_id = 8d5484a3-470b-499d-9fbd-cfa9bc9814b1 response_code = 204 uri = /eip-gateways
21532024-11-16T00:52:57.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64675
21542024-11-16T00:52:57.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64675 req_id = d139b94c-3610-4864-8c3a-da011187a549 response_code = 200 uri = /vpc-routes
21552024-11-16T00:52:57.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56578 req_id = 4fe60bd6-0b6b-441b-9dd3-55487a722750 response_code = 204 uri = /vpc-routes
21562024-11-16T00:52:57.784ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
21572024-11-16T00:52:57.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64675 req_id = ab47e926-d02f-41c9-94be-4c03183659c5 response_code = 204 uri = /eip-gateways
21582024-11-16T00:52:57.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64675 req_id = f20bf7d3-f388-4c8b-a152-330accd55dfc response_code = 204 uri = /vpc-routes
21592024-11-16T00:52:57.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54513
21602024-11-16T00:52:57.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54513 req_id = b6881584-34cb-43c0-abc4-1933f9f741f2 response_code = 200 uri = /v2p
21612024-11-16T00:52:57.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44667
21622024-11-16T00:52:57.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44667 req_id = c37d0187-c4c7-4f7e-8fef-31a139c7ecad response_code = 200 uri = /v2p
21632024-11-16T00:52:57.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63035
21642024-11-16T00:52:57.862ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21652024-11-16T00:52:57.902ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21662024-11-16T00:52:57.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98720 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63035 req_id = 90008456-f780-4b8d-8264-2a3e88df76bf response_code = 204 uri = /switch-ports
21672024-11-16T00:52:57.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60957
21682024-11-16T00:52:57.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63035 req_id = ca18b7a8-dff3-4784-8718-b8df8c149005 response_code = 200 uri = /network-bootstore-config
21692024-11-16T00:52:57.961ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21702024-11-16T00:52:57.996ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21712024-11-16T00:52:58.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82101 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60957 req_id = b3049dc2-993b-42cd-8b69-54487a362816 response_code = 204 uri = /switch-ports
21722024-11-16T00:52:58.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60957 req_id = b864dfc3-4d11-4585-8c2d-1cf16c0bdf57 response_code = 200 uri = /network-bootstore-config
21732024-11-16T00:52:59.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38452
21742024-11-16T00:52:59.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38452 req_id = 36f55852-1895-45cd-a625-d80ea71d3ce9 response_code = 200 uri = /vpc-routes
21752024-11-16T00:52:59.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45112
21762024-11-16T00:52:59.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45112 req_id = 175b0870-0600-4f91-a5f6-96c2520ae1f8 response_code = 200 uri = /v2p
21772024-11-16T00:52:59.972ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
21782024-11-16T00:52:59.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38452 req_id = 62eb8788-2580-4a39-ad27-a5bf87da3491 response_code = 204 uri = /eip-gateways
21792024-11-16T00:52:59.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38452 req_id = b63574b9-8c44-41e7-b08f-21851d593d56 response_code = 204 uri = /vpc-routes
21802024-11-16T00:53:00.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63999
21812024-11-16T00:53:00.047ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21822024-11-16T00:53:00.086ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21832024-11-16T00:53:00.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94705 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63999 req_id = 18df5e5c-97c6-4f32-bec1-57bf9fc6eeee response_code = 204 uri = /switch-ports
21842024-11-16T00:53:00.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63999 req_id = 7bd02590-f5e5-49a0-b658-b5be72a56cc2 response_code = 200 uri = /network-bootstore-config
21852024-11-16T00:53:13.511ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42278
21862024-11-16T00:53:13.511ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42278 req_id = aff6cb77-93ec-4a6e-b477-53147f7bc098 response_code = 200 uri = /baseboard
21872024-11-16T00:53:27.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58893
21882024-11-16T00:53:27.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58893 req_id = 40b3fe62-6be8-4185-9c95-2f9fedc5acac response_code = 200 uri = /vpc-routes
21892024-11-16T00:53:27.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55906
21902024-11-16T00:53:27.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55906 req_id = 1de1c2b1-77ce-4ced-9678-dfcab9c94d03 response_code = 200 uri = /vpc-routes
21912024-11-16T00:53:27.590ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
21922024-11-16T00:53:27.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55906 req_id = 1ee303e6-27f8-4a36-8bd6-ad43b7f3217e response_code = 204 uri = /eip-gateways
21932024-11-16T00:53:27.598ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
21942024-11-16T00:53:27.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58893 req_id = ebddc684-1b47-4b5e-8236-8b24b39a37c1 response_code = 204 uri = /eip-gateways
21952024-11-16T00:53:27.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55906 req_id = 07826ff9-ccad-4e0e-befb-8df47b60a8c4 response_code = 204 uri = /vpc-routes
21962024-11-16T00:53:27.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58893 req_id = a13f8b78-24f1-413d-93c5-a90b589def73 response_code = 204 uri = /vpc-routes
21972024-11-16T00:53:27.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37966
21982024-11-16T00:53:27.637ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21992024-11-16T00:53:27.677ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22002024-11-16T00:53:27.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98803 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37966 req_id = f76ebbd1-fb14-40d1-9e64-da98a5fbb07a response_code = 204 uri = /switch-ports
22012024-11-16T00:53:27.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51447
22022024-11-16T00:53:27.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37647
22032024-11-16T00:53:27.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35803
22042024-11-16T00:53:27.736ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22052024-11-16T00:53:27.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3668 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37647 req_id = 7bca2386-8e21-4679-94df-85110294799d response_code = 200 uri = /v2p
22062024-11-16T00:53:27.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3725 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37966 req_id = 97311717-4e1e-410b-a9ab-b29da55fd3c0 response_code = 200 uri = /network-bootstore-config
22072024-11-16T00:53:27.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4048 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51447 req_id = 3c1cf214-b204-476b-bbe1-15ca6c255a0d response_code = 200 uri = /v2p
22082024-11-16T00:53:27.770ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22092024-11-16T00:53:27.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91258 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35803 req_id = 75de8e27-ba2f-4f02-851c-b2061bf0bb3f response_code = 204 uri = /switch-ports
22102024-11-16T00:53:27.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35803 req_id = 7ad0d4dc-1c05-46f7-b6de-5049e5fb285c response_code = 200 uri = /network-bootstore-config
22112024-11-16T00:53:29.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51678
22122024-11-16T00:53:29.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51678 req_id = e0d87bc0-5085-405d-9aeb-7d5b21fc27d5 response_code = 200 uri = /vpc-routes
22132024-11-16T00:53:29.774ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
22142024-11-16T00:53:29.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51678 req_id = 874f7667-bd48-4919-909f-8e2587a1c445 response_code = 204 uri = /eip-gateways
22152024-11-16T00:53:29.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51678 req_id = 2b940fc3-5833-408e-b7fe-67853f872a84 response_code = 204 uri = /vpc-routes
22162024-11-16T00:53:29.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52429
22172024-11-16T00:53:29.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52429 req_id = 97bae9ac-e01a-4566-95a6-b81200e84b31 response_code = 200 uri = /v2p
22182024-11-16T00:53:29.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40696
22192024-11-16T00:53:29.863ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22202024-11-16T00:53:29.904ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22212024-11-16T00:53:29.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99303 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40696 req_id = 62ac6777-24b3-49bd-9f1c-e2c96ef97fa9 response_code = 204 uri = /switch-ports
22222024-11-16T00:53:29.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40696 req_id = d355b6ee-f80b-42b9-b650-bb3048790f56 response_code = 200 uri = /network-bootstore-config
22232024-11-16T00:53:43.546ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47006
22242024-11-16T00:53:43.546ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47006 req_id = 2b0bffc1-c419-4eb5-ac3b-6a19c91d4848 response_code = 200 uri = /baseboard
22252024-11-16T00:53:57.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41831
22262024-11-16T00:53:57.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41831 req_id = 583b0134-071a-403b-b23e-19ae8bd866a2 response_code = 200 uri = /vpc-routes
22272024-11-16T00:53:57.608ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
22282024-11-16T00:53:57.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41831 req_id = 7e9e2824-eb3e-4fe3-9415-aba38eb03363 response_code = 204 uri = /eip-gateways
22292024-11-16T00:53:57.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41831 req_id = e822cb1b-dbe2-4bd8-9a02-025b873cfacd response_code = 204 uri = /vpc-routes
22302024-11-16T00:53:57.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64527
22312024-11-16T00:53:57.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64527 req_id = 5fbb4f3b-e39f-4fc2-a542-a612d2f8d11a response_code = 200 uri = /vpc-routes
22322024-11-16T00:53:57.669ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
22332024-11-16T00:53:57.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64527 req_id = 3c3fb9e5-7c8f-406e-b600-909caf2fcecb response_code = 204 uri = /eip-gateways
22342024-11-16T00:53:57.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64527 req_id = 16101c7e-0928-4c11-9b50-6b55f25b2304 response_code = 204 uri = /vpc-routes
22352024-11-16T00:53:57.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54455
22362024-11-16T00:53:57.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54455 req_id = 92ca6202-1c58-4b4c-8d00-0ce50adc1947 response_code = 200 uri = /v2p
22372024-11-16T00:53:57.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40738
22382024-11-16T00:53:57.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40738 req_id = 6697d62c-4b91-45a3-b02c-86c36cf8a1a7 response_code = 200 uri = /v2p
22392024-11-16T00:53:57.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43173
22402024-11-16T00:53:57.831ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22412024-11-16T00:53:57.873ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22422024-11-16T00:53:57.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101434 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43173 req_id = 88b26045-109b-44f5-948f-de1d61df5d47 response_code = 204 uri = /switch-ports
22432024-11-16T00:53:57.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53584
22442024-11-16T00:53:57.932ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22452024-11-16T00:53:57.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4089 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43173 req_id = ed864db1-7cda-4d4b-950a-ddd81a6ead17 response_code = 200 uri = /network-bootstore-config
22462024-11-16T00:53:57.967ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22472024-11-16T00:53:58.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88220 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53584 req_id = e82a6aca-0e12-4194-998d-6ca48748c98f response_code = 204 uri = /switch-ports
22482024-11-16T00:53:58.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53584 req_id = eca0c32c-7421-45e3-827d-d9d027d28a70 response_code = 200 uri = /network-bootstore-config
22492024-11-16T00:53:59.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58378
22502024-11-16T00:53:59.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58378 req_id = 947f4379-f4bb-4c41-b9ac-9d219e4a1dfb response_code = 200 uri = /vpc-routes
22512024-11-16T00:53:59.872ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
22522024-11-16T00:53:59.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58378 req_id = 6b321a18-73c4-4af2-bbf1-7d458d1924ca response_code = 204 uri = /eip-gateways
22532024-11-16T00:53:59.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58378 req_id = 38e2422d-44e2-4c2b-ae0b-b7e62b555eab response_code = 204 uri = /vpc-routes
22542024-11-16T00:54:00.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49201
22552024-11-16T00:54:00.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49201 req_id = f8a8e8aa-fe6b-442e-9994-b2b1c6fa7a14 response_code = 200 uri = /v2p
22562024-11-16T00:54:00.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65103
22572024-11-16T00:54:00.094ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22582024-11-16T00:54:00.135ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22592024-11-16T00:54:00.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99250 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65103 req_id = 1d56ab9c-0a21-4a6a-92c2-4e44bb0cebac response_code = 204 uri = /switch-ports
22602024-11-16T00:54:00.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65103 req_id = dbe9d2c5-40dc-4877-9c0b-2dcd7585b113 response_code = 200 uri = /network-bootstore-config
22612024-11-16T00:54:13.578ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47566
22622024-11-16T00:54:13.579ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47566 req_id = 62281da0-ba88-4360-998d-315569d15173 response_code = 200 uri = /baseboard
22632024-11-16T00:54:27.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64901
22642024-11-16T00:54:27.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64901 req_id = e3bc3f36-3b6e-4bfc-858a-03ac2c18aec5 response_code = 200 uri = /vpc-routes
22652024-11-16T00:54:27.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38138
22662024-11-16T00:54:27.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38138 req_id = 2f136731-ae0e-4d6d-b230-1ed425137827 response_code = 200 uri = /vpc-routes
22672024-11-16T00:54:27.548ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
22682024-11-16T00:54:27.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64901 req_id = 5a35e4e1-0819-49ff-857f-09a576a289ee response_code = 204 uri = /eip-gateways
22692024-11-16T00:54:27.549ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
22702024-11-16T00:54:27.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38138 req_id = 8e1aa572-15ed-4355-a1ad-ccadab466097 response_code = 204 uri = /eip-gateways
22712024-11-16T00:54:27.554ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58750
22722024-11-16T00:54:27.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58750 req_id = c79d9e2f-9ea3-48d3-9819-5f7ea6072b02 response_code = 200 uri = /v2p
22732024-11-16T00:54:27.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64901 req_id = 8f5d68cc-0e66-475c-91c8-f7b60a120264 response_code = 204 uri = /vpc-routes
22742024-11-16T00:54:27.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38138 req_id = 74dad882-a547-4b43-a319-1e6f3ee9ca92 response_code = 204 uri = /vpc-routes
22752024-11-16T00:54:27.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53478
22762024-11-16T00:54:27.621ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22772024-11-16T00:54:27.662ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22782024-11-16T00:54:27.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104426 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53478 req_id = d694979e-e134-463d-8149-1875da4f51da response_code = 204 uri = /switch-ports
22792024-11-16T00:54:27.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35725
22802024-11-16T00:54:27.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63095
22812024-11-16T00:54:27.725ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22822024-11-16T00:54:27.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53478 req_id = ece4000f-7f3d-4d95-86e5-4a315ac68712 response_code = 200 uri = /network-bootstore-config
22832024-11-16T00:54:27.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35725 req_id = b553023c-f080-4394-88c5-a4b4d67c034a response_code = 200 uri = /v2p
22842024-11-16T00:54:27.761ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22852024-11-16T00:54:27.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92347 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63095 req_id = 79c78949-b0e1-4695-b5fa-3c86d02e07a2 response_code = 204 uri = /switch-ports
22862024-11-16T00:54:27.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63095 req_id = fb5bedd7-439b-4031-baf7-7bacfe63fe3a response_code = 200 uri = /network-bootstore-config
22872024-11-16T00:54:29.709ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55543
22882024-11-16T00:54:29.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55543 req_id = 245c361d-13af-4b1a-9da1-233133a10865 response_code = 200 uri = /v2p
22892024-11-16T00:54:29.712ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61528
22902024-11-16T00:54:29.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61528 req_id = 131ac79d-3fb9-4461-ab50-b560f07db3da response_code = 200 uri = /vpc-routes
22912024-11-16T00:54:29.754ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
22922024-11-16T00:54:29.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61528 req_id = 10c6d6b2-a240-45fe-b278-9c5e3b1bc5d1 response_code = 204 uri = /eip-gateways
22932024-11-16T00:54:29.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61528 req_id = 108ba5ab-8dac-48a8-aa29-caaf34aa2fa1 response_code = 204 uri = /vpc-routes
22942024-11-16T00:54:29.788ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61085
22952024-11-16T00:54:29.788ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22962024-11-16T00:54:29.830ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22972024-11-16T00:54:29.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102162 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61085 req_id = 6145ba25-a624-4406-97a7-9492a48ab0ce response_code = 204 uri = /switch-ports
22982024-11-16T00:54:29.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61085 req_id = a0e59b6f-ac9d-475f-901b-0f18b18e1c15 response_code = 200 uri = /network-bootstore-config
22992024-11-16T00:54:29.894ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23002024-11-16T00:54:29.897ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23012024-11-16T00:54:29.897ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23022024-11-16T00:54:29.899ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23032024-11-16T00:54:29.900ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23042024-11-16T00:54:29.901ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23052024-11-16T00:54:29.901ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23062024-11-16T00:54:29.902ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23072024-11-16T00:54:29.905ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23082024-11-16T00:54:37.556ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23092024-11-16T00:54:37.556ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
23102024-11-16T00:54:37.590ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1970, tv_nsec: 611349809 } time_to_next_cleanup = 599.999994969s
23112024-11-16T00:54:39.896ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23122024-11-16T00:54:39.897ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23132024-11-16T00:54:39.898ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23142024-11-16T00:54:39.899ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23152024-11-16T00:54:39.899ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23162024-11-16T00:54:39.900ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23172024-11-16T00:54:39.901ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23182024-11-16T00:54:39.901ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23192024-11-16T00:54:39.902ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23202024-11-16T00:54:39.902ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23212024-11-16T00:54:39.903ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23222024-11-16T00:54:39.905ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23232024-11-16T00:54:39.905ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23242024-11-16T00:54:39.906ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23252024-11-16T00:54:39.907ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23262024-11-16T00:54:39.907ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23272024-11-16T00:54:39.908ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23282024-11-16T00:54:39.910ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23292024-11-16T00:54:43.612ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50409
23302024-11-16T00:54:43.612ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50409 req_id = fa93941c-0bfc-4fcd-b328-6c25935caa7c response_code = 200 uri = /baseboard
23312024-11-16T00:54:49.900ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23322024-11-16T00:54:49.901ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23332024-11-16T00:54:49.902ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23342024-11-16T00:54:49.902ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23352024-11-16T00:54:49.903ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23362024-11-16T00:54:49.904ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23372024-11-16T00:54:49.904ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23382024-11-16T00:54:49.905ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23392024-11-16T00:54:49.906ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23402024-11-16T00:54:49.906ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23412024-11-16T00:54:49.907ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23422024-11-16T00:54:49.907ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23432024-11-16T00:54:49.908ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23442024-11-16T00:54:49.909ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23452024-11-16T00:54:49.909ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23462024-11-16T00:54:49.910ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23472024-11-16T00:54:49.910ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23482024-11-16T00:54:49.913ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23492024-11-16T00:54:52.040ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23502024-11-16T00:54:57.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64548
23512024-11-16T00:54:57.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64548 req_id = 3209ce36-0d65-4bb6-8d75-798e32b4dcca response_code = 200 uri = /v2p
23522024-11-16T00:54:57.640ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44242
23532024-11-16T00:54:57.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44242 req_id = 5557bac2-f9b6-46d9-9f85-5232308188f8 response_code = 200 uri = /vpc-routes
23542024-11-16T00:54:57.661ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
23552024-11-16T00:54:57.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44242 req_id = 0e83a1bd-1eb5-43ff-8a0c-3659e2c20966 response_code = 204 uri = /eip-gateways
23562024-11-16T00:54:57.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40524
23572024-11-16T00:54:57.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40524 req_id = 2272075e-be3e-43b6-bf0d-64ea1a9cdbf9 response_code = 200 uri = /vpc-routes
23582024-11-16T00:54:57.783ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
23592024-11-16T00:54:57.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40524 req_id = a29ef228-e286-4727-b65f-bb953d72254d response_code = 204 uri = /eip-gateways
23602024-11-16T00:54:57.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57572
23612024-11-16T00:54:57.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57572 req_id = ea0bd5de-37dd-473f-8414-7a0ad1493c39 response_code = 200 uri = /v2p
23622024-11-16T00:54:57.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40524 req_id = c2cb74d1-43f8-4e53-b9c9-c2c13ceebd83 response_code = 204 uri = /vpc-routes
23632024-11-16T00:54:57.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44242 req_id = 53c8c7cc-c084-42e7-9a84-5844abefa9b0 response_code = 204 uri = /vpc-routes
23642024-11-16T00:54:57.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56224
23652024-11-16T00:54:57.828ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23662024-11-16T00:54:57.869ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23672024-11-16T00:54:57.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100986 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56224 req_id = 0b4d45eb-d381-4599-bbd1-5dab8172e1fd response_code = 204 uri = /switch-ports
23682024-11-16T00:54:57.929ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35414
23692024-11-16T00:54:57.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56224 req_id = 3aa08d9f-eaea-4c86-9799-da9a99c1930c response_code = 200 uri = /network-bootstore-config
23702024-11-16T00:54:57.929ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23712024-11-16T00:54:57.970ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23722024-11-16T00:54:58.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95225 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35414 req_id = e00b60c9-5172-47b0-a86a-db25985b6db8 response_code = 204 uri = /switch-ports
23732024-11-16T00:54:58.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35414 req_id = 03adae7e-69fd-41ad-91ce-622c878f1281 response_code = 200 uri = /network-bootstore-config
23742024-11-16T00:54:59.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35596
23752024-11-16T00:54:59.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35596 req_id = 262213a6-6088-4565-9cb0-0a90ad80ebcc response_code = 200 uri = /vpc-routes
23762024-11-16T00:54:59.769ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
23772024-11-16T00:54:59.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35596 req_id = f45fd47c-56e9-4250-a26a-5ee55bf27c66 response_code = 204 uri = /eip-gateways
23782024-11-16T00:54:59.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35596 req_id = 9fc1bffa-3120-4494-bbab-5a3281a42e0c response_code = 204 uri = /vpc-routes
23792024-11-16T00:54:59.904ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23802024-11-16T00:54:59.905ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23812024-11-16T00:54:59.906ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23822024-11-16T00:54:59.906ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23832024-11-16T00:54:59.907ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23842024-11-16T00:54:59.907ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23852024-11-16T00:54:59.908ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23862024-11-16T00:54:59.909ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23872024-11-16T00:54:59.909ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23882024-11-16T00:54:59.910ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23892024-11-16T00:54:59.911ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23902024-11-16T00:54:59.911ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23912024-11-16T00:54:59.912ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23922024-11-16T00:54:59.912ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23932024-11-16T00:54:59.913ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23942024-11-16T00:54:59.913ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23952024-11-16T00:54:59.914ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23962024-11-16T00:54:59.916ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
23972024-11-16T00:54:59.970ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44369
23982024-11-16T00:54:59.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44369 req_id = a8b0b66f-9ecb-4fb8-a36b-516e42a3237b response_code = 200 uri = /v2p
23992024-11-16T00:54:59.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43672
24002024-11-16T00:54:59.989ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24012024-11-16T00:55:00.032ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24022024-11-16T00:55:00.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101731 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43672 req_id = 2313c000-2484-4394-9fba-da4a5c1e53c5 response_code = 204 uri = /switch-ports
24032024-11-16T00:55:00.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43672 req_id = 424abec4-b4f7-4781-99cb-1599cfa42a9f response_code = 200 uri = /network-bootstore-config
24042024-11-16T00:55:09.908ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24052024-11-16T00:55:09.909ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24062024-11-16T00:55:09.910ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24072024-11-16T00:55:09.911ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24082024-11-16T00:55:09.912ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24092024-11-16T00:55:09.913ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24102024-11-16T00:55:09.914ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24112024-11-16T00:55:09.914ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24122024-11-16T00:55:09.915ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24132024-11-16T00:55:09.915ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24142024-11-16T00:55:09.916ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24152024-11-16T00:55:09.917ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24162024-11-16T00:55:09.917ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24172024-11-16T00:55:09.918ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24182024-11-16T00:55:09.919ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24192024-11-16T00:55:09.919ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24202024-11-16T00:55:09.919ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24212024-11-16T00:55:09.922ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24222024-11-16T00:55:13.649ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37369
24232024-11-16T00:55:13.649ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37369 req_id = 78a05bf5-95b5-488e-aae5-ca3a7b184d76 response_code = 200 uri = /baseboard
24242024-11-16T00:55:19.912ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24252024-11-16T00:55:19.913ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24262024-11-16T00:55:19.914ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24272024-11-16T00:55:19.914ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24282024-11-16T00:55:19.915ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24292024-11-16T00:55:19.916ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24302024-11-16T00:55:19.916ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24312024-11-16T00:55:19.917ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24322024-11-16T00:55:19.918ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24332024-11-16T00:55:19.918ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24342024-11-16T00:55:19.919ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24352024-11-16T00:55:19.919ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24362024-11-16T00:55:19.920ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24372024-11-16T00:55:19.921ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24382024-11-16T00:55:19.921ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24392024-11-16T00:55:19.922ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24402024-11-16T00:55:19.922ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24412024-11-16T00:55:19.925ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24422024-11-16T00:55:27.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40086
24432024-11-16T00:55:27.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40086 req_id = 9889308b-3467-40af-96ab-d709c4b87694 response_code = 200 uri = /vpc-routes
24442024-11-16T00:55:27.517ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
24452024-11-16T00:55:27.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40086 req_id = 7572748d-dcdf-42d2-9de1-f55a2673a474 response_code = 204 uri = /eip-gateways
24462024-11-16T00:55:27.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40086 req_id = 4e2e426a-b204-42be-9f95-d37fac21643a response_code = 204 uri = /vpc-routes
24472024-11-16T00:55:27.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45440
24482024-11-16T00:55:27.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45440 req_id = 23597092-c602-4aec-9e22-4922901c3621 response_code = 200 uri = /vpc-routes
24492024-11-16T00:55:27.543ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
24502024-11-16T00:55:27.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45440 req_id = bf995eb9-aa6a-45d1-85bf-236357182b55 response_code = 204 uri = /eip-gateways
24512024-11-16T00:55:27.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55202
24522024-11-16T00:55:27.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55202 req_id = 54a7ab32-6f9a-4423-a109-0fff73cc8312 response_code = 200 uri = /v2p
24532024-11-16T00:55:27.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45440 req_id = bdf5b591-9376-4db8-bc05-82eae98901cb response_code = 204 uri = /vpc-routes
24542024-11-16T00:55:27.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56860
24552024-11-16T00:55:27.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56860 req_id = 17427335-cc8c-499b-9f04-ee38cfaba58a response_code = 200 uri = /v2p
24562024-11-16T00:55:27.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63954
24572024-11-16T00:55:27.620ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24582024-11-16T00:55:27.661ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24592024-11-16T00:55:27.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94025 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63954 req_id = c5e3b118-cbcc-44f3-84c3-c511ee3f16f3 response_code = 204 uri = /switch-ports
24602024-11-16T00:55:27.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50735
24612024-11-16T00:55:27.714ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24622024-11-16T00:55:27.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63954 req_id = 9de342a9-352a-4584-876d-7db3d6e8e3a4 response_code = 200 uri = /network-bootstore-config
24632024-11-16T00:55:27.749ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24642024-11-16T00:55:27.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86834 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50735 req_id = 1e95eb71-2bb2-41cc-9fb0-942e9320ee52 response_code = 204 uri = /switch-ports
24652024-11-16T00:55:27.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50735 req_id = 279bfdb0-0fcc-4aaf-8551-ab041b1a7636 response_code = 200 uri = /network-bootstore-config
24662024-11-16T00:55:29.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65192
24672024-11-16T00:55:29.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65192 req_id = 69f3cbff-1928-4038-861f-c6ec380da714 response_code = 200 uri = /vpc-routes
24682024-11-16T00:55:29.758ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
24692024-11-16T00:55:29.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65192 req_id = 7e4f0869-516d-4497-8921-9a5425fbda31 response_code = 204 uri = /eip-gateways
24702024-11-16T00:55:29.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65192 req_id = 8acb7789-ea10-4ff2-bf0b-de65257591f3 response_code = 204 uri = /vpc-routes
24712024-11-16T00:55:29.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36597
24722024-11-16T00:55:29.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36597 req_id = 26dfa9f0-062e-4bd7-9fa9-392d8244b19f response_code = 200 uri = /v2p
24732024-11-16T00:55:29.800ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43309
24742024-11-16T00:55:29.800ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24752024-11-16T00:55:29.843ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24762024-11-16T00:55:29.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103439 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43309 req_id = 10e90fb7-c4ed-413f-b0c5-c19974a758bf response_code = 204 uri = /switch-ports
24772024-11-16T00:55:29.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43309 req_id = 96d63aab-e543-42dd-8e9e-e12b38418bef response_code = 200 uri = /network-bootstore-config
24782024-11-16T00:55:29.916ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24792024-11-16T00:55:29.918ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24802024-11-16T00:55:29.919ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24812024-11-16T00:55:29.920ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24822024-11-16T00:55:29.921ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24832024-11-16T00:55:29.922ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24842024-11-16T00:55:29.924ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24852024-11-16T00:55:29.925ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24862024-11-16T00:55:29.925ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24872024-11-16T00:55:29.926ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24882024-11-16T00:55:29.927ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24892024-11-16T00:55:29.927ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24902024-11-16T00:55:29.928ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24912024-11-16T00:55:29.928ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24922024-11-16T00:55:29.929ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24932024-11-16T00:55:29.929ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24942024-11-16T00:55:29.930ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24952024-11-16T00:55:29.932ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24962024-11-16T00:55:39.922ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24972024-11-16T00:55:39.923ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24982024-11-16T00:55:39.924ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
24992024-11-16T00:55:39.925ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25002024-11-16T00:55:39.925ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25012024-11-16T00:55:39.926ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25022024-11-16T00:55:39.927ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25032024-11-16T00:55:39.927ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25042024-11-16T00:55:39.928ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25052024-11-16T00:55:39.928ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25062024-11-16T00:55:39.929ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25072024-11-16T00:55:39.930ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25082024-11-16T00:55:39.930ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25092024-11-16T00:55:39.931ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25102024-11-16T00:55:39.931ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25112024-11-16T00:55:39.932ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25122024-11-16T00:55:39.932ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25132024-11-16T00:55:39.935ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25142024-11-16T00:55:43.682ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43091
25152024-11-16T00:55:43.682ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43091 req_id = 5fc7c7cc-c357-4092-bc7c-66f32065719c response_code = 200 uri = /baseboard
25162024-11-16T00:55:49.925ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25172024-11-16T00:55:49.927ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25182024-11-16T00:55:49.928ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25192024-11-16T00:55:49.928ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25202024-11-16T00:55:49.929ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25212024-11-16T00:55:49.930ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25222024-11-16T00:55:49.930ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25232024-11-16T00:55:49.931ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25242024-11-16T00:55:49.932ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25252024-11-16T00:55:49.932ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25262024-11-16T00:55:49.933ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25272024-11-16T00:55:49.933ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25282024-11-16T00:55:49.934ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25292024-11-16T00:55:49.935ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25302024-11-16T00:55:49.935ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25312024-11-16T00:55:49.936ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25322024-11-16T00:55:49.936ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25332024-11-16T00:55:49.939ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25342024-11-16T00:55:57.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55862
25352024-11-16T00:55:57.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55862 req_id = 655274b5-1bcf-4ee0-97eb-e8b338a6fe8e response_code = 200 uri = /vpc-routes
25362024-11-16T00:55:57.662ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
25372024-11-16T00:55:57.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55862 req_id = 65312afb-354d-4fff-85ae-2851c3b19471 response_code = 204 uri = /eip-gateways
25382024-11-16T00:55:57.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34496
25392024-11-16T00:55:57.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34496 req_id = 4396314e-92ff-4668-acbd-5e7adedf8458 response_code = 200 uri = /vpc-routes
25402024-11-16T00:55:57.782ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
25412024-11-16T00:55:57.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34496 req_id = 8664879f-44fd-434a-b58e-e3c7070df958 response_code = 204 uri = /eip-gateways
25422024-11-16T00:55:57.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34496 req_id = 038d5168-bdbe-4ef7-a298-5a316677205b response_code = 204 uri = /vpc-routes
25432024-11-16T00:55:57.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61513
25442024-11-16T00:55:57.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61513 req_id = 2ff33f42-9cfe-470c-9eec-d26fae48e3d7 response_code = 200 uri = /v2p
25452024-11-16T00:55:57.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59381
25462024-11-16T00:55:57.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59381 req_id = f3df5816-68f1-4639-a219-fd745457132b response_code = 200 uri = /v2p
25472024-11-16T00:55:57.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55862 req_id = fb454010-d181-4e08-8141-b80b77097817 response_code = 204 uri = /vpc-routes
25482024-11-16T00:55:57.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35639
25492024-11-16T00:55:57.830ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25502024-11-16T00:55:57.871ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25512024-11-16T00:55:57.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102210 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35639 req_id = 2ab98c8e-7e01-498d-95cf-7e1794f4ded5 response_code = 204 uri = /switch-ports
25522024-11-16T00:55:57.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65175
25532024-11-16T00:55:57.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35639 req_id = cb270a46-4637-4533-ba91-91a1b98c36a2 response_code = 200 uri = /network-bootstore-config
25542024-11-16T00:55:57.933ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25552024-11-16T00:55:57.968ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25562024-11-16T00:55:58.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95662 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65175 req_id = 66417a8f-5314-4e2a-b9d8-7a29382964dc response_code = 204 uri = /switch-ports
25572024-11-16T00:55:58.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65175 req_id = 841f7268-78f6-4896-a8fa-5bdebda5e9f6 response_code = 200 uri = /network-bootstore-config
25582024-11-16T00:55:59.891ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38784
25592024-11-16T00:55:59.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38784 req_id = 54316cd4-6608-4a33-921b-9cedaf8b72b6 response_code = 200 uri = /vpc-routes
25602024-11-16T00:55:59.905ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
25612024-11-16T00:55:59.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38784 req_id = 2f11bc29-9160-48c5-9859-c5e5e7b4ea72 response_code = 204 uri = /eip-gateways
25622024-11-16T00:55:59.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38784 req_id = 6c8c1aa1-fdf0-4eb7-8cf6-d55cd7e84101 response_code = 204 uri = /vpc-routes
25632024-11-16T00:55:59.930ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25642024-11-16T00:55:59.931ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25652024-11-16T00:55:59.932ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25662024-11-16T00:55:59.934ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25672024-11-16T00:55:59.934ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25682024-11-16T00:55:59.935ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25692024-11-16T00:55:59.936ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25702024-11-16T00:55:59.937ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25712024-11-16T00:55:59.938ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25722024-11-16T00:55:59.938ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25732024-11-16T00:55:59.939ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25742024-11-16T00:55:59.940ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25752024-11-16T00:55:59.941ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25762024-11-16T00:55:59.942ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25772024-11-16T00:55:59.942ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25782024-11-16T00:55:59.943ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25792024-11-16T00:55:59.943ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25802024-11-16T00:55:59.946ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25812024-11-16T00:56:00.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53047
25822024-11-16T00:56:00.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53047 req_id = 7a28df3d-300d-48bf-ae01-0f91def3a635 response_code = 200 uri = /v2p
25832024-11-16T00:56:00.098ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64116
25842024-11-16T00:56:00.098ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25852024-11-16T00:56:00.141ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25862024-11-16T00:56:00.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101140 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64116 req_id = 70cbad8a-48ac-43cd-9317-d714c294063e response_code = 204 uri = /switch-ports
25872024-11-16T00:56:00.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64116 req_id = 9d6390f5-5c87-4ef3-b667-e0b540c4bc19 response_code = 200 uri = /network-bootstore-config
25882024-11-16T00:56:09.934ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25892024-11-16T00:56:09.935ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25902024-11-16T00:56:09.936ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25912024-11-16T00:56:09.937ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25922024-11-16T00:56:09.937ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25932024-11-16T00:56:09.938ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25942024-11-16T00:56:09.939ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25952024-11-16T00:56:09.939ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25962024-11-16T00:56:09.940ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25972024-11-16T00:56:09.940ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25982024-11-16T00:56:09.941ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
25992024-11-16T00:56:09.942ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26002024-11-16T00:56:09.943ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26012024-11-16T00:56:09.943ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26022024-11-16T00:56:09.944ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26032024-11-16T00:56:09.944ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26042024-11-16T00:56:09.945ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26052024-11-16T00:56:09.947ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26062024-11-16T00:56:13.715ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41946
26072024-11-16T00:56:13.715ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41946 req_id = 24e4b2db-f4e7-4323-9635-d05c3e6b8ece response_code = 200 uri = /baseboard
26082024-11-16T00:56:19.939ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26092024-11-16T00:56:19.940ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26102024-11-16T00:56:19.941ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26112024-11-16T00:56:19.942ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26122024-11-16T00:56:19.942ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26132024-11-16T00:56:19.943ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26142024-11-16T00:56:19.944ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26152024-11-16T00:56:19.944ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26162024-11-16T00:56:19.945ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26172024-11-16T00:56:19.945ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26182024-11-16T00:56:19.946ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26192024-11-16T00:56:19.946ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26202024-11-16T00:56:19.947ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26212024-11-16T00:56:19.948ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26222024-11-16T00:56:19.948ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26232024-11-16T00:56:19.949ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26242024-11-16T00:56:19.949ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26252024-11-16T00:56:19.952ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26262024-11-16T00:56:27.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52834
26272024-11-16T00:56:27.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52834 req_id = 62e57eb8-4cf1-4950-8c0e-c49da2f1946f response_code = 200 uri = /vpc-routes
26282024-11-16T00:56:27.529ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
26292024-11-16T00:56:27.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52834 req_id = f8a0ca78-8b86-4e2b-9b0f-ec265b732390 response_code = 204 uri = /eip-gateways
26302024-11-16T00:56:27.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52834 req_id = 495036b4-11a0-4cdf-b4ec-18ea04522a26 response_code = 204 uri = /vpc-routes
26312024-11-16T00:56:27.547ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36833
26322024-11-16T00:56:27.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36833 req_id = 22f6d349-e0ab-417f-81e4-a2803a9daf96 response_code = 200 uri = /vpc-routes
26332024-11-16T00:56:27.563ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
26342024-11-16T00:56:27.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36833 req_id = 0fe69486-b02d-4a8c-b1f3-41d96571e210 response_code = 204 uri = /eip-gateways
26352024-11-16T00:56:27.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33576
26362024-11-16T00:56:27.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33576 req_id = b4549a97-ab9f-4922-b5d1-5034fc3b4a73 response_code = 200 uri = /v2p
26372024-11-16T00:56:27.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56290
26382024-11-16T00:56:27.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56290 req_id = d62adb76-70c0-4f0f-98af-758dc449246f response_code = 200 uri = /v2p
26392024-11-16T00:56:27.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48399
26402024-11-16T00:56:27.630ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26412024-11-16T00:56:27.673ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26422024-11-16T00:56:27.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103394 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48399 req_id = ab6d95cb-471d-4b69-b1ef-e3207f65b1de response_code = 204 uri = /switch-ports
26432024-11-16T00:56:27.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65436
26442024-11-16T00:56:27.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 355 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36833 req_id = 5fdae9ac-4e7a-4290-bc49-266bc23c6113 response_code = 204 uri = /vpc-routes
26452024-11-16T00:56:27.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48399 req_id = fdf99efd-fc0a-488c-b85d-227df728e827 response_code = 200 uri = /network-bootstore-config
26462024-11-16T00:56:27.734ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26472024-11-16T00:56:27.773ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26482024-11-16T00:56:27.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95440 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65436 req_id = 82ae0cf0-f8ab-4cd2-9d40-88eb97b6d768 response_code = 204 uri = /switch-ports
26492024-11-16T00:56:27.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65436 req_id = da6fcf77-ef34-4a0c-a9ca-223d43d983db response_code = 200 uri = /network-bootstore-config
26502024-11-16T00:56:29.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35159
26512024-11-16T00:56:29.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35159 req_id = 90b9ac2f-16e1-45bb-98bc-f50d4ea97abb response_code = 200 uri = /vpc-routes
26522024-11-16T00:56:29.747ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
26532024-11-16T00:56:29.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35159 req_id = 826a8361-6b6b-4034-b0e7-b06540d41d69 response_code = 204 uri = /eip-gateways
26542024-11-16T00:56:29.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35159 req_id = d32dbef9-56d6-45bf-87c7-bc26cc288e08 response_code = 204 uri = /vpc-routes
26552024-11-16T00:56:29.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34187
26562024-11-16T00:56:29.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34187 req_id = 1f6c74ad-519a-4fae-bd29-9d4c15e3a60b response_code = 200 uri = /v2p
26572024-11-16T00:56:29.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47595
26582024-11-16T00:56:29.876ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26592024-11-16T00:56:29.922ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26602024-11-16T00:56:29.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101552 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47595 req_id = c9d5b72a-bf67-4c05-ad2b-77da61700e02 response_code = 204 uri = /switch-ports
26612024-11-16T00:56:29.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47595 req_id = e960f4d5-290a-49f4-a3ec-844b8d9ee478 response_code = 200 uri = /network-bootstore-config
26622024-11-16T00:56:29.981ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26632024-11-16T00:56:29.982ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26642024-11-16T00:56:29.983ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26652024-11-16T00:56:29.983ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26662024-11-16T00:56:29.984ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26672024-11-16T00:56:29.984ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26682024-11-16T00:56:29.985ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26692024-11-16T00:56:29.986ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26702024-11-16T00:56:29.986ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26712024-11-16T00:56:29.987ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26722024-11-16T00:56:29.987ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26732024-11-16T00:56:29.988ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26742024-11-16T00:56:29.988ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26752024-11-16T00:56:29.989ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26762024-11-16T00:56:29.990ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26772024-11-16T00:56:29.990ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26782024-11-16T00:56:29.992ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26792024-11-16T00:56:29.993ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26802024-11-16T00:56:39.985ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26812024-11-16T00:56:39.986ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26822024-11-16T00:56:39.987ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26832024-11-16T00:56:39.987ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26842024-11-16T00:56:39.988ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26852024-11-16T00:56:39.989ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26862024-11-16T00:56:39.990ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26872024-11-16T00:56:39.990ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26882024-11-16T00:56:39.991ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26892024-11-16T00:56:39.991ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26902024-11-16T00:56:39.992ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26912024-11-16T00:56:39.992ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26922024-11-16T00:56:39.993ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26932024-11-16T00:56:39.994ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26942024-11-16T00:56:39.994ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26952024-11-16T00:56:39.995ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26962024-11-16T00:56:39.997ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26972024-11-16T00:56:39.998ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
26982024-11-16T00:56:43.748ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60379
26992024-11-16T00:56:43.748ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60379 req_id = 395550e9-de5e-419b-946b-9c473dd93af6 response_code = 200 uri = /baseboard
27002024-11-16T00:56:49.989ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
27012024-11-16T00:56:49.990ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
27022024-11-16T00:56:49.990ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
27032024-11-16T00:56:49.991ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
27042024-11-16T00:56:49.992ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
27052024-11-16T00:56:49.992ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
27062024-11-16T00:56:49.993ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
27072024-11-16T00:56:49.993ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
27082024-11-16T00:56:49.994ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
27092024-11-16T00:56:49.994ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
27102024-11-16T00:56:49.995ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
27112024-11-16T00:56:49.996ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
27122024-11-16T00:56:49.996ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
27132024-11-16T00:56:49.997ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
27142024-11-16T00:56:49.997ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
27152024-11-16T00:56:49.998ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
27162024-11-16T00:56:50.000ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
27172024-11-16T00:56:50.001ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
27182024-11-16T00:56:57.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51120
27192024-11-16T00:56:57.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51120 req_id = 13287de0-3ae9-4946-ad17-2a1a913b6362 response_code = 200 uri = /v2p
27202024-11-16T00:56:57.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57922
27212024-11-16T00:56:57.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57922 req_id = bbd56553-665e-46c0-9563-35547317ddb7 response_code = 200 uri = /vpc-routes
27222024-11-16T00:56:57.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47741
27232024-11-16T00:56:57.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47741 req_id = f831b766-77a9-4dd0-b6c0-d9a935caa65f response_code = 200 uri = /vpc-routes
27242024-11-16T00:56:57.746ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
27252024-11-16T00:56:57.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47741 req_id = 52724fbb-b8ba-418a-80c8-9aa80088c1f4 response_code = 204 uri = /eip-gateways
27262024-11-16T00:56:57.782ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
27272024-11-16T00:56:57.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57922 req_id = e9afe03c-d141-4986-8b91-b61ab73f7ed6 response_code = 204 uri = /eip-gateways
27282024-11-16T00:56:57.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57922 req_id = 8f78630d-7923-47db-83f4-233c6b240276 response_code = 204 uri = /vpc-routes
27292024-11-16T00:56:57.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41383
27302024-11-16T00:56:57.883ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27312024-11-16T00:56:57.935ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27322024-11-16T00:56:58.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117604 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41383 req_id = 8c2bb055-aee8-4ee1-8a3a-4ecfc97452b7 response_code = 204 uri = /switch-ports
27332024-11-16T00:56:58.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45387
27342024-11-16T00:56:58.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43452
27352024-11-16T00:56:58.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61392
27362024-11-16T00:56:58.002ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27372024-11-16T00:56:58.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43452 req_id = 5cc4e255-b77d-40f5-b4e0-9c00b40d7f24 response_code = 200 uri = /v2p
27382024-11-16T00:56:58.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 360 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41383 req_id = ac629f9b-c39c-4c95-9d23-928c314ce15d response_code = 200 uri = /network-bootstore-config
27392024-11-16T00:56:58.002ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27402024-11-16T00:56:58.002ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27412024-11-16T00:56:58.002ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/omicron-zones.json file = common/src/ledger.rs:177
27422024-11-16T00:56:58.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10023 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47741 req_id = c911cf64-7fa6-4f53-a8e4-ef792cad5e01 response_code = 204 uri = /vpc-routes
27432024-11-16T00:56:58.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34260
27442024-11-16T00:56:58.012ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27452024-11-16T00:56:58.017ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/omicron-zones.json file = common/src/ledger.rs:177
27462024-11-16T00:56:58.027ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36845
27472024-11-16T00:56:58.027ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 590b90e0-533a-4c8d-9965-a74bed460cd8, kind: Service { id: 3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888 }, name: Name("external-dns-3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 11])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 729e6010-0a28-4302-8831-f6612b85a78f, kind: Service { id: 4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf }, name: Name("external-dns-4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4c60317e-983a-4ac6-8708-96d944c78888, kind: Service { id: 6d7cf1e6-3ed9-42bc-8f17-49159affac6b }, name: Name("nexus-6d7cf1e6-3ed9-42bc-8f17-49159affac6b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 86c67e2b-8c46-4e16-8253-9de9bc79f0fa, kind: Service { id: cebce92a-579a-4295-b410-4ce799c5bf29 }, name: Name("nexus-cebce92a-579a-4295-b410-4ce799c5bf29"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa85ba01-9643-4c9d-8080-62de967b5b63, kind: Service { id: ff27fc99-a5d9-4c14-972a-fc3b1a67eb96 }, name: Name("nexus-ff27fc99-a5d9-4c14-972a-fc3b1a67eb96"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 158])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27482024-11-16T00:56:58.027ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27492024-11-16T00:56:58.027ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27502024-11-16T00:56:58.027ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27512024-11-16T00:56:58.027ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27522024-11-16T00:56:58.027ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
27532024-11-16T00:56:58.027ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27542024-11-16T00:56:58.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 368 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36845 req_id = af2bc9a7-da31-48d4-82e0-9bf509fbae03 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27552024-11-16T00:56:58.034ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27562024-11-16T00:56:58.034ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8dfb8147-eb55-4ee1-89a5-25b2d27c68ee
27572024-11-16T00:56:58.052ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27582024-11-16T00:56:58.052ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/omicron-zones.json file = common/src/ledger.rs:177
27592024-11-16T00:56:58.056ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27602024-11-16T00:56:58.062ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/omicron-zones.json file = common/src/ledger.rs:177
27612024-11-16T00:56:58.067ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27622024-11-16T00:56:58.067ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d49e8c8c-eb53-43b6-a176-aee4725796df
27632024-11-16T00:56:58.084ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27642024-11-16T00:56:58.084ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8dfb8147-eb55-4ee1-89a5-25b2d27c68ee
27652024-11-16T00:56:58.112ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27662024-11-16T00:56:58.112ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d49e8c8c-eb53-43b6-a176-aee4725796df
27672024-11-16T00:56:58.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44822
27682024-11-16T00:56:58.122ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 590b90e0-533a-4c8d-9965-a74bed460cd8, kind: Service { id: 3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888 }, name: Name("external-dns-3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 11])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 729e6010-0a28-4302-8831-f6612b85a78f, kind: Service { id: 4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf }, name: Name("external-dns-4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4c60317e-983a-4ac6-8708-96d944c78888, kind: Service { id: 6d7cf1e6-3ed9-42bc-8f17-49159affac6b }, name: Name("nexus-6d7cf1e6-3ed9-42bc-8f17-49159affac6b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 86c67e2b-8c46-4e16-8253-9de9bc79f0fa, kind: Service { id: cebce92a-579a-4295-b410-4ce799c5bf29 }, name: Name("nexus-cebce92a-579a-4295-b410-4ce799c5bf29"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa85ba01-9643-4c9d-8080-62de967b5b63, kind: Service { id: ff27fc99-a5d9-4c14-972a-fc3b1a67eb96 }, name: Name("nexus-ff27fc99-a5d9-4c14-972a-fc3b1a67eb96"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 158])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27692024-11-16T00:56:58.122ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27702024-11-16T00:56:58.122ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27712024-11-16T00:56:58.122ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27722024-11-16T00:56:58.122ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27732024-11-16T00:56:58.122ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
27742024-11-16T00:56:58.122ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27752024-11-16T00:56:58.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44822 req_id = 0208bb2f-e277-45fc-8c09-20c0a4a3c8e5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27762024-11-16T00:56:58.128ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27772024-11-16T00:56:58.128ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_220cf814-be1b-400b-bb43-5ab45b7eb044
27782024-11-16T00:56:58.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123736 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34260 req_id = cbf2bf06-d604-43aa-b462-900be82cc277 response_code = 204 uri = /switch-ports
27792024-11-16T00:56:58.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34260 req_id = fbc1ea19-3785-412a-a8ea-5d3676fe46e5 response_code = 200 uri = /network-bootstore-config
27802024-11-16T00:56:58.145ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27812024-11-16T00:56:58.145ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_220cf814-be1b-400b-bb43-5ab45b7eb044
27822024-11-16T00:56:58.159ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27832024-11-16T00:56:58.159ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b3e7398e-9645-46d0-a57a-4bd06e1408a3
27842024-11-16T00:56:58.184ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27852024-11-16T00:56:58.184ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_eb288506-11eb-4ffc-bf84-f6c1550028b7
27862024-11-16T00:56:58.197ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27872024-11-16T00:56:58.197ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b3e7398e-9645-46d0-a57a-4bd06e1408a3
27882024-11-16T00:56:58.215ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2df48cc0-997e-4c6b-92f6-f05e369b8ceb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27892024-11-16T00:56:58.215ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2df48cc0-997e-4c6b-92f6-f05e369b8ceb
27902024-11-16T00:56:58.230ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27912024-11-16T00:56:58.230ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_eb288506-11eb-4ffc-bf84-f6c1550028b7
27922024-11-16T00:56:58.253ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2df48cc0-997e-4c6b-92f6-f05e369b8ceb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27932024-11-16T00:56:58.253ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2df48cc0-997e-4c6b-92f6-f05e369b8ceb
27942024-11-16T00:56:58.266ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 769d1181-4cb2-4e0f-87be-d1b20a8a9c58 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27952024-11-16T00:56:58.266ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_769d1181-4cb2-4e0f-87be-d1b20a8a9c58
27962024-11-16T00:56:58.282ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 769d1181-4cb2-4e0f-87be-d1b20a8a9c58 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27972024-11-16T00:56:58.282ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_769d1181-4cb2-4e0f-87be-d1b20a8a9c58
27982024-11-16T00:56:58.295ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27992024-11-16T00:56:58.295ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad26846d-9efb-4f49-8d19-f73f5a25617e
28002024-11-16T00:56:58.317ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28012024-11-16T00:56:58.317ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_96d0d34c-625d-45e2-b0db-1fbc7541f944
28022024-11-16T00:56:58.328ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28032024-11-16T00:56:58.328ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad26846d-9efb-4f49-8d19-f73f5a25617e
28042024-11-16T00:56:58.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 331338 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61392 req_id = e5faeca2-28b1-42d4-998e-8f2aa4543aec response_code = 200 uri = /inventory
28052024-11-16T00:56:58.350ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28062024-11-16T00:56:58.350ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_96d0d34c-625d-45e2-b0db-1fbc7541f944
28072024-11-16T00:56:58.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 360143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45387 req_id = adb9534d-bef1-42d5-a76f-2219b4c03320 response_code = 200 uri = /inventory
28082024-11-16T00:56:59.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61085
28092024-11-16T00:56:59.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61085 req_id = 1ddbc918-57fa-4e60-8350-426c64d89371 response_code = 200 uri = /vpc-routes
28102024-11-16T00:56:59.816ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
28112024-11-16T00:56:59.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61085 req_id = 2c35c71d-7d4c-4af7-adbb-f6f997a3c4e0 response_code = 204 uri = /eip-gateways
28122024-11-16T00:56:59.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61085 req_id = 14fac281-0620-4a42-8af4-d4027eb7e160 response_code = 204 uri = /vpc-routes
28132024-11-16T00:56:59.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37395
28142024-11-16T00:56:59.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37395 req_id = cbce0daa-ddcb-4271-8c92-0aa0938066d6 response_code = 200 uri = /v2p
28152024-11-16T00:56:59.993ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28162024-11-16T00:56:59.994ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28172024-11-16T00:56:59.994ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28182024-11-16T00:56:59.995ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28192024-11-16T00:56:59.996ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28202024-11-16T00:56:59.996ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28212024-11-16T00:56:59.997ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28222024-11-16T00:56:59.997ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28232024-11-16T00:56:59.998ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28242024-11-16T00:56:59.999ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28252024-11-16T00:56:59.999ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28262024-11-16T00:57:00.000ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28272024-11-16T00:57:00.000ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28282024-11-16T00:57:00.001ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28292024-11-16T00:57:00.001ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28302024-11-16T00:57:00.002ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28312024-11-16T00:57:00.005ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28322024-11-16T00:57:00.005ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28332024-11-16T00:57:00.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60390
28342024-11-16T00:57:00.094ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28352024-11-16T00:57:00.133ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28362024-11-16T00:57:00.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95353 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60390 req_id = b200dc3b-fa41-4802-b5ca-510c45ccf8a8 response_code = 204 uri = /switch-ports
28372024-11-16T00:57:00.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59414
28382024-11-16T00:57:00.190ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28392024-11-16T00:57:00.190ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28402024-11-16T00:57:00.190ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/config/omicron-zones.json file = common/src/ledger.rs:177
28412024-11-16T00:57:00.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60390 req_id = 4e774c54-6d34-4de6-8014-2548fe4c1c8c response_code = 200 uri = /network-bootstore-config
28422024-11-16T00:57:00.190ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/config/omicron-zones.json file = common/src/ledger.rs:177
28432024-11-16T00:57:00.205ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8dfb8147-eb55-4ee1-89a5-25b2d27c68ee (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28442024-11-16T00:57:00.205ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8dfb8147-eb55-4ee1-89a5-25b2d27c68ee
28452024-11-16T00:57:00.229ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53527
28462024-11-16T00:57:00.229ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 590b90e0-533a-4c8d-9965-a74bed460cd8, kind: Service { id: 3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888 }, name: Name("external-dns-3fa7bf58-2f14-4e4d-8427-d4d2bf9a7888"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 11])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 729e6010-0a28-4302-8831-f6612b85a78f, kind: Service { id: 4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf }, name: Name("external-dns-4789218f-0ce6-4ce8-afb3-a6d16b0e8eaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4c60317e-983a-4ac6-8708-96d944c78888, kind: Service { id: 6d7cf1e6-3ed9-42bc-8f17-49159affac6b }, name: Name("nexus-6d7cf1e6-3ed9-42bc-8f17-49159affac6b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 86c67e2b-8c46-4e16-8253-9de9bc79f0fa, kind: Service { id: cebce92a-579a-4295-b410-4ce799c5bf29 }, name: Name("nexus-cebce92a-579a-4295-b410-4ce799c5bf29"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa85ba01-9643-4c9d-8080-62de967b5b63, kind: Service { id: ff27fc99-a5d9-4c14-972a-fc3b1a67eb96 }, name: Name("nexus-ff27fc99-a5d9-4c14-972a-fc3b1a67eb96"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 158])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28472024-11-16T00:57:00.229ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28482024-11-16T00:57:00.230ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28492024-11-16T00:57:00.230ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28502024-11-16T00:57:00.230ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28512024-11-16T00:57:00.230ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28522024-11-16T00:57:00.230ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28532024-11-16T00:57:00.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 347 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53527 req_id = 8833d0a8-57ba-4e79-82ac-7c636a9eb6fa response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28542024-11-16T00:57:00.234ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d49e8c8c-eb53-43b6-a176-aee4725796df (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28552024-11-16T00:57:00.234ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d49e8c8c-eb53-43b6-a176-aee4725796df
28562024-11-16T00:57:00.259ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 220cf814-be1b-400b-bb43-5ab45b7eb044 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28572024-11-16T00:57:00.259ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_220cf814-be1b-400b-bb43-5ab45b7eb044
28582024-11-16T00:57:00.282ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3e7398e-9645-46d0-a57a-4bd06e1408a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28592024-11-16T00:57:00.283ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b3e7398e-9645-46d0-a57a-4bd06e1408a3
28602024-11-16T00:57:00.307ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eb288506-11eb-4ffc-bf84-f6c1550028b7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28612024-11-16T00:57:00.307ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_eb288506-11eb-4ffc-bf84-f6c1550028b7
28622024-11-16T00:57:00.329ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2df48cc0-997e-4c6b-92f6-f05e369b8ceb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28632024-11-16T00:57:00.329ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2df48cc0-997e-4c6b-92f6-f05e369b8ceb
28642024-11-16T00:57:00.352ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 769d1181-4cb2-4e0f-87be-d1b20a8a9c58 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28652024-11-16T00:57:00.352ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_769d1181-4cb2-4e0f-87be-d1b20a8a9c58
28662024-11-16T00:57:00.374ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad26846d-9efb-4f49-8d19-f73f5a25617e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28672024-11-16T00:57:00.374ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad26846d-9efb-4f49-8d19-f73f5a25617e
28682024-11-16T00:57:00.396ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 96d0d34c-625d-45e2-b0db-1fbc7541f944 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28692024-11-16T00:57:00.396ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_96d0d34c-625d-45e2-b0db-1fbc7541f944
28702024-11-16T00:57:00.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219582 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59414 req_id = 1df3f2e8-3692-437d-929f-6b8dc1d9a73c response_code = 200 uri = /inventory
28712024-11-16T00:57:09.997ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28722024-11-16T00:57:09.997ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28732024-11-16T00:57:09.998ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28742024-11-16T00:57:09.999ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28752024-11-16T00:57:09.999ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28762024-11-16T00:57:10.000ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28772024-11-16T00:57:10.001ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28782024-11-16T00:57:10.001ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28792024-11-16T00:57:10.002ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28802024-11-16T00:57:10.002ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28812024-11-16T00:57:10.003ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28822024-11-16T00:57:10.004ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28832024-11-16T00:57:10.004ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28842024-11-16T00:57:10.005ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28852024-11-16T00:57:10.005ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28862024-11-16T00:57:10.006ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28872024-11-16T00:57:10.008ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28882024-11-16T00:57:10.009ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28892024-11-16T00:57:13.781ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53585
28902024-11-16T00:57:13.781ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53585 req_id = 0a02cfac-7c17-4bb4-ba7f-a1eaceb81306 response_code = 200 uri = /baseboard
28912024-11-16T00:57:20.000ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28922024-11-16T00:57:20.001ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28932024-11-16T00:57:20.002ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28942024-11-16T00:57:20.003ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28952024-11-16T00:57:20.003ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28962024-11-16T00:57:20.004ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28972024-11-16T00:57:20.005ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28982024-11-16T00:57:20.005ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
28992024-11-16T00:57:20.006ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29002024-11-16T00:57:20.006ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29012024-11-16T00:57:20.007ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29022024-11-16T00:57:20.007ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29032024-11-16T00:57:20.008ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29042024-11-16T00:57:20.009ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29052024-11-16T00:57:20.009ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29062024-11-16T00:57:20.010ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29072024-11-16T00:57:20.012ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29082024-11-16T00:57:20.013ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29092024-11-16T00:57:27.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41550
29102024-11-16T00:57:27.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41550 req_id = a432edad-f0c5-4438-8462-54b4304e3768 response_code = 200 uri = /vpc-routes
29112024-11-16T00:57:27.485ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
29122024-11-16T00:57:27.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41550 req_id = 8532bde0-3ab9-4076-9d29-1e816759a91d response_code = 204 uri = /eip-gateways
29132024-11-16T00:57:27.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38510
29142024-11-16T00:57:27.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38510 req_id = d464f154-ff50-4ce4-9fe7-717194c0d2a9 response_code = 200 uri = /vpc-routes
29152024-11-16T00:57:27.572ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
29162024-11-16T00:57:27.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38510 req_id = 702fc9db-edf0-498c-a18b-16b3310387fc response_code = 204 uri = /eip-gateways
29172024-11-16T00:57:27.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38510 req_id = e2c2a103-89ea-4da9-a5d0-7d37d222709e response_code = 204 uri = /vpc-routes
29182024-11-16T00:57:27.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62792
29192024-11-16T00:57:27.591ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29202024-11-16T00:57:27.632ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29212024-11-16T00:57:27.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101764 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62792 req_id = 1c13e17b-7300-4e12-a60e-4647d03e5659 response_code = 204 uri = /switch-ports
29222024-11-16T00:57:27.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48039
29232024-11-16T00:57:27.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44078
29242024-11-16T00:57:27.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62792 req_id = 0a03e8f7-10a1-4d2d-bb97-0ca648bff824 response_code = 200 uri = /network-bootstore-config
29252024-11-16T00:57:27.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 497 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41550 req_id = 6e1dae7e-09da-49a7-a7e9-3e4d7d50edc2 response_code = 204 uri = /vpc-routes
29262024-11-16T00:57:27.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48039 req_id = 7c933b59-6c1b-4600-859d-a4fd6fc8c5b5 response_code = 200 uri = /v2p
29272024-11-16T00:57:27.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44078 req_id = 2fe8e8da-fafb-4808-947e-fd57bcfe05a6 response_code = 200 uri = /v2p
29282024-11-16T00:57:27.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56701
29292024-11-16T00:57:27.795ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29302024-11-16T00:57:27.833ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29312024-11-16T00:57:27.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98468 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56701 req_id = d633ad7d-0cd4-47cd-96b1-1d1ff0f14a15 response_code = 204 uri = /switch-ports
29322024-11-16T00:57:27.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56701 req_id = 6780c1ab-8c8b-4d71-9448-45e7e04d6162 response_code = 200 uri = /network-bootstore-config
29332024-11-16T00:57:29.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45263
29342024-11-16T00:57:29.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45263 req_id = 01a9af45-16a0-4c98-a98e-c63599806372 response_code = 200 uri = /vpc-routes
29352024-11-16T00:57:29.753ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
29362024-11-16T00:57:29.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45263 req_id = 9b7afdef-6fc0-4e1d-a639-d0ed957f90ed response_code = 204 uri = /eip-gateways
29372024-11-16T00:57:29.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45866
29382024-11-16T00:57:29.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45866 req_id = 41bb009a-9979-4e13-a649-bb7b36ed554b response_code = 200 uri = /v2p
29392024-11-16T00:57:29.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45263 req_id = 09576391-6fa9-4484-b6e6-aa28553de1e3 response_code = 204 uri = /vpc-routes
29402024-11-16T00:57:29.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58432
29412024-11-16T00:57:29.862ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29422024-11-16T00:57:29.899ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29432024-11-16T00:57:29.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99120 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58432 req_id = 3d0fec04-e913-4d47-8bb1-5c7871c14241 response_code = 204 uri = /switch-ports
29442024-11-16T00:57:29.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58432 req_id = ad0d5316-3a00-4f29-bf9d-0842587bdb54 response_code = 200 uri = /network-bootstore-config
29452024-11-16T00:57:30.005ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29462024-11-16T00:57:30.006ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29472024-11-16T00:57:30.006ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29482024-11-16T00:57:30.007ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29492024-11-16T00:57:30.007ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29502024-11-16T00:57:30.008ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29512024-11-16T00:57:30.009ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29522024-11-16T00:57:30.009ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29532024-11-16T00:57:30.010ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29542024-11-16T00:57:30.010ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29552024-11-16T00:57:30.011ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29562024-11-16T00:57:30.012ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29572024-11-16T00:57:30.012ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29582024-11-16T00:57:30.013ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29592024-11-16T00:57:30.013ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29602024-11-16T00:57:30.014ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29612024-11-16T00:57:30.016ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29622024-11-16T00:57:30.017ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29632024-11-16T00:57:40.009ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29642024-11-16T00:57:40.010ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29652024-11-16T00:57:40.010ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29662024-11-16T00:57:40.011ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29672024-11-16T00:57:40.012ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29682024-11-16T00:57:40.012ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29692024-11-16T00:57:40.013ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29702024-11-16T00:57:40.014ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29712024-11-16T00:57:40.014ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29722024-11-16T00:57:40.015ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29732024-11-16T00:57:40.015ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29742024-11-16T00:57:40.016ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29752024-11-16T00:57:40.017ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29762024-11-16T00:57:40.017ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29772024-11-16T00:57:40.018ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29782024-11-16T00:57:40.018ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29792024-11-16T00:57:40.021ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29802024-11-16T00:57:40.021ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29812024-11-16T00:57:43.813ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45278
29822024-11-16T00:57:43.813ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45278 req_id = f934e0cf-85b4-41ea-9809-93bc8e5252e7 response_code = 200 uri = /baseboard
29832024-11-16T00:57:50.012ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29842024-11-16T00:57:50.013ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29852024-11-16T00:57:50.013ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29862024-11-16T00:57:50.014ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29872024-11-16T00:57:50.015ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29882024-11-16T00:57:50.015ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29892024-11-16T00:57:50.016ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29902024-11-16T00:57:50.016ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29912024-11-16T00:57:50.017ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29922024-11-16T00:57:50.017ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29932024-11-16T00:57:50.018ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29942024-11-16T00:57:50.019ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29952024-11-16T00:57:50.019ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29962024-11-16T00:57:50.020ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29972024-11-16T00:57:50.020ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29982024-11-16T00:57:50.021ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
29992024-11-16T00:57:50.023ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30002024-11-16T00:57:50.024ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30012024-11-16T00:57:57.691ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62713
30022024-11-16T00:57:57.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62713 req_id = bd6cf5cc-1721-46c6-a63a-c75a9ba3305c response_code = 200 uri = /vpc-routes
30032024-11-16T00:57:57.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60800
30042024-11-16T00:57:57.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60800 req_id = 48b2a233-5101-45f1-8c3c-929a7b5a7e96 response_code = 200 uri = /vpc-routes
30052024-11-16T00:57:57.711ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
30062024-11-16T00:57:57.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62713 req_id = d829c1fe-97fd-4d60-b36e-a6a63be3786a response_code = 204 uri = /eip-gateways
30072024-11-16T00:57:57.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62713 req_id = 34aa172e-5725-492b-b454-92423b189e28 response_code = 204 uri = /vpc-routes
30082024-11-16T00:57:57.763ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
30092024-11-16T00:57:57.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60800 req_id = fbc35f81-7abd-49e8-9b61-be3c5cd5dde1 response_code = 204 uri = /eip-gateways
30102024-11-16T00:57:57.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60800 req_id = 1a3ddb70-d471-404a-9e28-f62d54e3e888 response_code = 204 uri = /vpc-routes
30112024-11-16T00:57:57.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46781
30122024-11-16T00:57:57.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46781 req_id = d5b7e9cc-0310-4980-ba6e-43e57de2ba4c response_code = 200 uri = /v2p
30132024-11-16T00:57:57.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36794
30142024-11-16T00:57:57.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36794 req_id = 76dc2b79-d6d7-47ed-8dc5-6c098f435989 response_code = 200 uri = /v2p
30152024-11-16T00:57:57.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57790
30162024-11-16T00:57:57.841ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30172024-11-16T00:57:57.882ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30182024-11-16T00:57:57.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100190 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57790 req_id = f9abc6ca-7caf-42b6-a4c7-bb08c1cb0cf0 response_code = 204 uri = /switch-ports
30192024-11-16T00:57:57.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59270
30202024-11-16T00:57:57.942ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30212024-11-16T00:57:57.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57790 req_id = 7c3057f6-e6d3-457a-b7a4-d7e274fd6e6b response_code = 200 uri = /network-bootstore-config
30222024-11-16T00:57:57.979ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30232024-11-16T00:57:58.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96953 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59270 req_id = 0a420bb2-50cf-4bbb-974b-cad6dc18d7d6 response_code = 204 uri = /switch-ports
30242024-11-16T00:57:58.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59270 req_id = 27130eb6-5992-4378-ae66-78d475e60071 response_code = 200 uri = /network-bootstore-config
30252024-11-16T00:57:59.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46073
30262024-11-16T00:57:59.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46073 req_id = 4942a82c-9d8a-437a-8d25-28f38be3e026 response_code = 200 uri = /vpc-routes
30272024-11-16T00:57:59.851ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
30282024-11-16T00:57:59.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46073 req_id = 314a89d6-015d-46a3-b290-04c43a132ecc response_code = 204 uri = /eip-gateways
30292024-11-16T00:57:59.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46073 req_id = 0c50c9db-a0df-4f21-afb9-2d45ac5d7f6d response_code = 204 uri = /vpc-routes
30302024-11-16T00:58:00.015ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30312024-11-16T00:58:00.016ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30322024-11-16T00:58:00.017ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30332024-11-16T00:58:00.017ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30342024-11-16T00:58:00.018ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30352024-11-16T00:58:00.018ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30362024-11-16T00:58:00.019ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30372024-11-16T00:58:00.020ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30382024-11-16T00:58:00.020ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30392024-11-16T00:58:00.021ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30402024-11-16T00:58:00.021ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30412024-11-16T00:58:00.022ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30422024-11-16T00:58:00.022ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30432024-11-16T00:58:00.023ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30442024-11-16T00:58:00.024ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30452024-11-16T00:58:00.024ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30462024-11-16T00:58:00.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35288
30472024-11-16T00:58:00.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35288 req_id = c0eb5d4f-2afb-4db9-b41c-f7c26d9c1364 response_code = 200 uri = /v2p
30482024-11-16T00:58:00.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38704
30492024-11-16T00:58:00.027ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30502024-11-16T00:58:00.034ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30512024-11-16T00:58:00.037ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30522024-11-16T00:58:00.075ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30532024-11-16T00:58:00.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114121 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38704 req_id = f504eed0-c825-468c-a523-d5c1218c86e3 response_code = 204 uri = /switch-ports
30542024-11-16T00:58:00.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38704 req_id = 33ffe27e-537f-40ab-9edb-da45f71fbf29 response_code = 200 uri = /network-bootstore-config
30552024-11-16T00:58:10.019ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30562024-11-16T00:58:10.020ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30572024-11-16T00:58:10.021ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30582024-11-16T00:58:10.021ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30592024-11-16T00:58:10.022ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30602024-11-16T00:58:10.023ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30612024-11-16T00:58:10.023ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30622024-11-16T00:58:10.024ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30632024-11-16T00:58:10.024ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30642024-11-16T00:58:10.025ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30652024-11-16T00:58:10.025ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30662024-11-16T00:58:10.026ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30672024-11-16T00:58:10.026ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30682024-11-16T00:58:10.027ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30692024-11-16T00:58:10.028ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30702024-11-16T00:58:10.028ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30712024-11-16T00:58:10.037ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30722024-11-16T00:58:10.038ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30732024-11-16T00:58:13.846ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37264
30742024-11-16T00:58:13.846ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37264 req_id = e922f230-981c-42fe-86fb-b1f92e022f57 response_code = 200 uri = /baseboard
30752024-11-16T00:58:20.024ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30762024-11-16T00:58:20.025ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30772024-11-16T00:58:20.025ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30782024-11-16T00:58:20.026ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30792024-11-16T00:58:20.027ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30802024-11-16T00:58:20.027ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30812024-11-16T00:58:20.028ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30822024-11-16T00:58:20.028ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30832024-11-16T00:58:20.029ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30842024-11-16T00:58:20.030ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30852024-11-16T00:58:20.030ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30862024-11-16T00:58:20.031ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30872024-11-16T00:58:20.031ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30882024-11-16T00:58:20.032ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30892024-11-16T00:58:20.032ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30902024-11-16T00:58:20.033ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30912024-11-16T00:58:20.039ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30922024-11-16T00:58:20.040ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
30932024-11-16T00:58:27.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37495
30942024-11-16T00:58:27.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37495 req_id = 91d3bca3-f8b0-46cd-9326-a14a9a98a2f3 response_code = 200 uri = /vpc-routes
30952024-11-16T00:58:27.518ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
30962024-11-16T00:58:27.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37495 req_id = 65b0ea40-a1fd-43c4-b064-0aab5e27e327 response_code = 204 uri = /eip-gateways
30972024-11-16T00:58:27.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46463
30982024-11-16T00:58:27.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46463 req_id = 02aa11bd-5b27-46ab-bb92-44229adb9b2b response_code = 200 uri = /v2p
30992024-11-16T00:58:27.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37495 req_id = 1c518112-eddb-433b-aff2-0f05cb1c8bf3 response_code = 204 uri = /vpc-routes
31002024-11-16T00:58:27.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52871
31012024-11-16T00:58:27.602ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31022024-11-16T00:58:27.647ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31032024-11-16T00:58:27.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103708 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52871 req_id = 85937dd1-e1bd-4e93-86d5-790f370c369b response_code = 204 uri = /switch-ports
31042024-11-16T00:58:27.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35846
31052024-11-16T00:58:27.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60281
31062024-11-16T00:58:27.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50184
31072024-11-16T00:58:27.706ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31082024-11-16T00:58:27.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35846 req_id = c5fdc8d4-df19-4abe-84d4-24699bacdcc0 response_code = 200 uri = /vpc-routes
31092024-11-16T00:58:27.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5003 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52871 req_id = e4ce77c2-4b44-478b-8df1-8282bca87cd1 response_code = 200 uri = /network-bootstore-config
31102024-11-16T00:58:27.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4898 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60281 req_id = bc9b51c8-5e95-4c5f-a048-87e6eb4ae7d2 response_code = 200 uri = /v2p
31112024-11-16T00:58:27.744ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31122024-11-16T00:58:27.749ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
31132024-11-16T00:58:27.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 547 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35846 req_id = 24a849f6-1e61-40bc-bb3f-44a1ffe55840 response_code = 204 uri = /eip-gateways
31142024-11-16T00:58:27.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 908 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35846 req_id = f7d6aaa4-b528-48b7-a386-6ac2ed2ed026 response_code = 204 uri = /vpc-routes
31152024-11-16T00:58:27.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97653 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50184 req_id = 897ba337-3f24-4337-b064-5105e6d43807 response_code = 204 uri = /switch-ports
31162024-11-16T00:58:27.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50184 req_id = f063f4e8-7069-4c67-80d1-a50c9b1d889a response_code = 200 uri = /network-bootstore-config
31172024-11-16T00:58:29.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54579
31182024-11-16T00:58:29.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54579 req_id = 28bbcb5f-7ba0-4163-a3f4-274481f30feb response_code = 200 uri = /vpc-routes
31192024-11-16T00:58:29.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58873
31202024-11-16T00:58:29.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58873 req_id = 27754d02-32f3-4583-8e62-99c549b7b00d response_code = 200 uri = /v2p
31212024-11-16T00:58:29.798ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
31222024-11-16T00:58:29.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54579 req_id = 411e1485-d923-4bb9-bf3f-348cafaa51ab response_code = 204 uri = /eip-gateways
31232024-11-16T00:58:29.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54579 req_id = a4340ee6-7793-4691-ad64-120c95a11e0e response_code = 204 uri = /vpc-routes
31242024-11-16T00:58:29.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36695
31252024-11-16T00:58:29.850ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31262024-11-16T00:58:29.894ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31272024-11-16T00:58:29.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102705 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36695 req_id = ca09f1b9-6211-4d44-a39c-4da7812ac1a8 response_code = 204 uri = /switch-ports
31282024-11-16T00:58:29.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36695 req_id = 169b27e4-83e6-4699-ba8c-cb2a3e56cf5a response_code = 200 uri = /network-bootstore-config
31292024-11-16T00:58:30.028ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31302024-11-16T00:58:30.028ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31312024-11-16T00:58:30.029ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31322024-11-16T00:58:30.030ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31332024-11-16T00:58:30.030ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31342024-11-16T00:58:30.031ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31352024-11-16T00:58:30.032ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31362024-11-16T00:58:30.032ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31372024-11-16T00:58:30.033ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31382024-11-16T00:58:30.033ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31392024-11-16T00:58:30.034ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31402024-11-16T00:58:30.034ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31412024-11-16T00:58:30.035ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31422024-11-16T00:58:30.035ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31432024-11-16T00:58:30.036ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31442024-11-16T00:58:30.036ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31452024-11-16T00:58:30.041ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31462024-11-16T00:58:30.042ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31472024-11-16T00:58:40.032ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31482024-11-16T00:58:40.033ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31492024-11-16T00:58:40.033ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31502024-11-16T00:58:40.034ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31512024-11-16T00:58:40.035ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31522024-11-16T00:58:40.035ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31532024-11-16T00:58:40.036ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31542024-11-16T00:58:40.036ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31552024-11-16T00:58:40.037ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31562024-11-16T00:58:40.038ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31572024-11-16T00:58:40.038ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31582024-11-16T00:58:40.039ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31592024-11-16T00:58:40.040ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31602024-11-16T00:58:40.040ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31612024-11-16T00:58:40.041ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31622024-11-16T00:58:40.041ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31632024-11-16T00:58:40.044ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31642024-11-16T00:58:40.044ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31652024-11-16T00:58:43.880ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51551
31662024-11-16T00:58:43.880ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51551 req_id = c3576e62-8d8c-46b5-8a25-b12ea3629d48 response_code = 200 uri = /baseboard
31672024-11-16T00:58:50.037ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31682024-11-16T00:58:50.037ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31692024-11-16T00:58:50.038ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31702024-11-16T00:58:50.039ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31712024-11-16T00:58:50.040ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31722024-11-16T00:58:50.041ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31732024-11-16T00:58:50.041ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31742024-11-16T00:58:50.042ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31752024-11-16T00:58:50.043ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31762024-11-16T00:58:50.045ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31772024-11-16T00:58:50.046ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31782024-11-16T00:58:50.046ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31792024-11-16T00:58:50.047ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31802024-11-16T00:58:50.048ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31812024-11-16T00:58:50.048ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31822024-11-16T00:58:50.049ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31832024-11-16T00:58:50.051ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31842024-11-16T00:58:50.052ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
31852024-11-16T00:58:55.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47291
31862024-11-16T00:58:55.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47291 req_id = ecd21ed9-96f9-4e92-91e4-958ae19c545e response_code = 200 uri = /v2p
31872024-11-16T00:58:55.697ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(14993816) }
31882024-11-16T00:58:55.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47291 req_id = ecd43c8d-0ec2-4991-bd48-80f7a1e13c21 response_code = 204 uri = /v2p
31892024-11-16T00:58:55.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49769
31902024-11-16T00:58:55.886ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 451b7f61-da91-4c83-9cfa-fd02c085d7b5, kind: Instance { id: 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14993816), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 451b7f61-da91-4c83-9cfa-fd02c085d7b5, kind: Instance { id: 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14993816), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 451b7f61-da91-4c83-9cfa-fd02c085d7b5, kind: Instance { id: 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14993816), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(14993816))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 451b7f61-da91-4c83-9cfa-fd02c085d7b5, kind: Instance { id: 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14993816), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-3ffd799d305", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 7a696bac-c2e3-4c51-bf37-e191794aae81, read_only_parent: Some(Volume { block_size: 512, id: 8d950b17-77b8-4747-a1ab-9593061ce827, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 898aad02-23b7-4956-9228-afb3f9cbba74, key: Some("aAmZUhzxDseSj1frvYYAWd8q3xgFlgNi9vu0d2zDLnk="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19002", "[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::18]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 7a696bac-c2e3-4c51-bf37-e191794aae81, key: Some("dBNv6Ihm9xJjTqZYEZ0MNLauj4A1gWJh2+7144y8Sqw="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::15]:19003"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-3ffd799d305" }] }), cloud_init_bytes: Some(..) } instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 metadata = InstanceMetadata { silo_id: 5d52a244-fd7d-4c5e-ad2f-b8ef7b6a9a85, project_id: 9ae39047-3bf7-436f-bcf5-437feadb952f } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-16T00:58:55.882424100Z }
31912024-11-16T00:58:55.886ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 migration_id = None propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
31922024-11-16T00:58:55.886ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 migration_id = None propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 451b7f61-da91-4c83-9cfa-fd02c085d7b5, kind: Instance { id: 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14993816), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 451b7f61-da91-4c83-9cfa-fd02c085d7b5, kind: Instance { id: 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14993816), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 451b7f61-da91-4c83-9cfa-fd02c085d7b5, kind: Instance { id: 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14993816), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(14993816))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 451b7f61-da91-4c83-9cfa-fd02c085d7b5, kind: Instance { id: 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14993816), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-3ffd799d305", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 7a696bac-c2e3-4c51-bf37-e191794aae81, read_only_parent: Some(Volume { block_size: 512, id: 8d950b17-77b8-4747-a1ab-9593061ce827, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 898aad02-23b7-4956-9228-afb3f9cbba74, key: Some("aAmZUhzxDseSj1frvYYAWd8q3xgFlgNi9vu0d2zDLnk="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19002", "[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::18]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 7a696bac-c2e3-4c51-bf37-e191794aae81, key: Some("dBNv6Ihm9xJjTqZYEZ0MNLauj4A1gWJh2+7144y8Sqw="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::15]:19003"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-3ffd799d305" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-16T00:58:55.882424100Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
31932024-11-16T00:58:55.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3987 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49769 req_id = 958c9fee-714d-446c-85fc-8a32b8c98820 response_code = 200 uri = /vmms/3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
31942024-11-16T00:58:55.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36668
31952024-11-16T00:58:55.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 435 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36668 req_id = faee1b8a-685a-44ec-8313-4397e63f2fc5 response_code = 200 uri = /vmms/3385b93d-4ffb-4cac-a7a3-b2236ff37dc9/state
31962024-11-16T00:58:55.973ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 14993816 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
31972024-11-16T00:58:55.973ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
31982024-11-16T00:58:56.017ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9 file = illumos-utils/src/zone.rs:325 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
31992024-11-16T00:58:56.040ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9 file = illumos-utils/src/zone.rs:363 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32002024-11-16T00:58:56.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53355
32012024-11-16T00:58:56.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53355 req_id = f6c1816e-ced3-4d07-8771-fcd33f3bee7a response_code = 200 uri = /vpc-routes
32022024-11-16T00:58:56.064ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {451b7f61-da91-4c83-9cfa-fd02c085d7b5: {10.151.2.175: {15e23569-5fe8-4f84-8517-2de97e5b9be1}, 10.151.2.176: {15e23569-5fe8-4f84-8517-2de97e5b9be1}}} }
32032024-11-16T00:58:57.212ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32042024-11-16T00:58:57.212ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9 zone = oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32052024-11-16T00:58:57.535ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9") failed: Property not found. retry in 46.600033ms file = illumos-utils/src/svc.rs:36 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9 zone = oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32062024-11-16T00:58:57.600ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9") failed: Property not found. retry in 55.712905ms file = illumos-utils/src/svc.rs:36 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9 zone = oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32072024-11-16T00:58:57.679ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9") failed: Property not found. retry in 124.366212ms file = illumos-utils/src/svc.rs:36 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9 zone = oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32082024-11-16T00:58:57.691ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60931
32092024-11-16T00:58:57.836ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9") failed: Property not found. retry in 325.099965ms file = illumos-utils/src/svc.rs:36 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9 zone = oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32102024-11-16T00:58:57.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37517
32112024-11-16T00:58:57.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37517 req_id = cf023e21-3a7b-4dec-ac69-fb5eb55089c3 response_code = 200 uri = /vpc-routes
32122024-11-16T00:58:57.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36966
32132024-11-16T00:58:57.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57068
32142024-11-16T00:58:57.883ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32152024-11-16T00:58:57.947ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32162024-11-16T00:58:58.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151811 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57068 req_id = 6afe5bf3-a464-4900-be84-dfa4b7e1c95c response_code = 204 uri = /switch-ports
32172024-11-16T00:58:58.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33900
32182024-11-16T00:58:58.035ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {451b7f61-da91-4c83-9cfa-fd02c085d7b5: {10.151.2.176: {15e23569-5fe8-4f84-8517-2de97e5b9be1}, 10.151.2.175: {15e23569-5fe8-4f84-8517-2de97e5b9be1}}} }
32192024-11-16T00:58:58.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37517 req_id = 4228dadc-3ebd-4211-b370-7f589de6502c response_code = 204 uri = /eip-gateways
32202024-11-16T00:58:58.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 389 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57068 req_id = 6db833b1-274e-4d8d-b1a4-7f0d8d2256b8 response_code = 200 uri = /network-bootstore-config
32212024-11-16T00:58:58.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33900 req_id = 9373e75e-8063-4872-93f2-19f356c210c1 response_code = 200 uri = /v2p
32222024-11-16T00:58:58.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34346
32232024-11-16T00:58:58.038ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32242024-11-16T00:58:58.094ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32252024-11-16T00:58:58.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140895 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34346 req_id = c3a5139a-0158-4cf9-871c-3eced5b24a27 response_code = 204 uri = /switch-ports
32262024-11-16T00:58:58.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39564
32272024-11-16T00:58:58.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 396 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34346 req_id = a72268f8-d8a8-45e0-963a-b1f2fb83fecd response_code = 200 uri = /network-bootstore-config
32282024-11-16T00:58:58.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1554 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37517 req_id = 41f8bf47-61d7-43b5-bc68-cb60c4962466 response_code = 204 uri = /vpc-routes
32292024-11-16T00:58:58.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 580 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39564 req_id = 81de32ee-23c2-4e40-8ffb-a2731d10d588 response_code = 200 uri = /v2p
32302024-11-16T00:58:58.194ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9") failed: Property not found. retry in 431.706505ms file = illumos-utils/src/svc.rs:36 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9 zone = oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32312024-11-16T00:58:58.639ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9") failed: Property not found. retry in 1.103020377s file = illumos-utils/src/svc.rs:36 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9 zone = oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32322024-11-16T00:58:59.756ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9") failed: Property not found. retry in 785.505097ms file = illumos-utils/src/svc.rs:36 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9 zone = oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32332024-11-16T00:58:59.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33606
32342024-11-16T00:58:59.929ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39177
32352024-11-16T00:58:59.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39177 req_id = d583820d-1f80-4b50-ab34-ed5da6c06f29 response_code = 200 uri = /vpc-routes
32362024-11-16T00:58:59.974ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {451b7f61-da91-4c83-9cfa-fd02c085d7b5: {10.151.2.176: {15e23569-5fe8-4f84-8517-2de97e5b9be1}, 10.151.2.175: {15e23569-5fe8-4f84-8517-2de97e5b9be1}}} }
32372024-11-16T00:58:59.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39177 req_id = 2f115c4a-c50c-4506-b84e-5ea4927061e0 response_code = 204 uri = /eip-gateways
32382024-11-16T00:58:59.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39177 req_id = 6d0dd9cd-6ad8-4eef-84d1-5bc9227dc553 response_code = 204 uri = /vpc-routes
32392024-11-16T00:59:00.041ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32402024-11-16T00:59:00.042ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32412024-11-16T00:59:00.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48149
32422024-11-16T00:59:00.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48149 req_id = dfcdb093-a6e8-4e21-98a4-a19a82ffa13d response_code = 200 uri = /v2p
32432024-11-16T00:59:00.043ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32442024-11-16T00:59:00.043ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32452024-11-16T00:59:00.044ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32462024-11-16T00:59:00.044ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32472024-11-16T00:59:00.045ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32482024-11-16T00:59:00.046ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32492024-11-16T00:59:00.046ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32502024-11-16T00:59:00.047ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32512024-11-16T00:59:00.047ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32522024-11-16T00:59:00.048ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32532024-11-16T00:59:00.049ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32542024-11-16T00:59:00.050ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32552024-11-16T00:59:00.050ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32562024-11-16T00:59:00.051ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32572024-11-16T00:59:00.053ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32582024-11-16T00:59:00.054ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32592024-11-16T00:59:00.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40596
32602024-11-16T00:59:00.054ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32612024-11-16T00:59:00.094ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32622024-11-16T00:59:00.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103650 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40596 req_id = 29747dbb-b248-4e15-b543-7aba493a813b response_code = 204 uri = /switch-ports
32632024-11-16T00:59:00.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40596 req_id = 9858d298-751d-4cdb-8974-098b0cf45272 response_code = 200 uri = /network-bootstore-config
32642024-11-16T00:59:00.554ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9") failed: Property not found. retry in 527.401498ms file = illumos-utils/src/svc.rs:36 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9 zone = oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32652024-11-16T00:59:01.094ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9") failed: Property not found. retry in 1.210742571s file = illumos-utils/src/svc.rs:36 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9 zone = oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32662024-11-16T00:59:02.339ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9 file = sled-agent/src/instance.rs:1787 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32672024-11-16T00:59:02.348ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9") failed: Property not found. retry in 64.468885ms file = illumos-utils/src/svc.rs:36 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32682024-11-16T00:59:02.425ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9") failed: Property not found. retry in 80.461271ms file = illumos-utils/src/svc.rs:36 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32692024-11-16T00:59:02.518ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9") failed: Property not found. retry in 161.570639ms file = illumos-utils/src/svc.rs:36 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32702024-11-16T00:59:02.694ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9") failed: Property not found. retry in 390.315246ms file = illumos-utils/src/svc.rs:36 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32712024-11-16T00:59:03.098ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32722024-11-16T00:59:03.135ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32732024-11-16T00:59:03.286ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32742024-11-16T00:59:03.288ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1231 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32752024-11-16T00:59:03.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3396142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33606 req_id = 7dd0d98b-a869-491e-ba0a-c9df4b5812f0 response_code = 200 uri = /vmms/3385b93d-4ffb-4cac-a7a3-b2236ff37dc9/state
32762024-11-16T00:59:03.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5597160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60931 req_id = 019406c5-6a6c-442d-9c6d-7cec8c76fb91 response_code = 200 uri = /vmms/3385b93d-4ffb-4cac-a7a3-b2236ff37dc9/state
32772024-11-16T00:59:03.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7224881 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53355 req_id = a47028fa-1370-470a-9c13-7b2f3205b2ef response_code = 204 uri = /eip-gateways
32782024-11-16T00:59:03.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5253784 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36966 req_id = 5e1e864b-1b1f-4207-827f-38a4c98351bb response_code = 200 uri = /vmms/3385b93d-4ffb-4cac-a7a3-b2236ff37dc9/state
32792024-11-16T00:59:03.289ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-16T00:59:03.289110975Z } file = sled-agent/src/instance.rs:780 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32802024-11-16T00:59:03.289ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-16T00:59:03.289110975Z } propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32812024-11-16T00:59:03.289ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-16T00:59:03.289110975Z }, migration_in: None, migration_out: None }
32822024-11-16T00:59:03.342ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-16T00:59:03.342210206Z } file = sled-agent/src/instance.rs:780 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32832024-11-16T00:59:03.342ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-16T00:59:03.342210206Z } propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
32842024-11-16T00:59:03.342ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-16T00:59:03.342210206Z }, migration_in: None, migration_out: None }
32852024-11-16T00:59:03.434ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: c757e624-1ce7-4e23-b387-56f9ada11f30, version: 3 } old_vers = RouterVersion { router_id: c757e624-1ce7-4e23-b387-56f9ada11f30, version: 3 } subnet = RouterId { vni: Vni(14993816), kind: System }
32862024-11-16T00:59:03.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53355 req_id = fdde7615-c3f8-47ea-8d8b-ad6a45bac545 response_code = 204 uri = /vpc-routes
32872024-11-16T00:59:03.493ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52438
32882024-11-16T00:59:03.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52438 req_id = 25fbc7bc-2156-4251-ab52-9167d5a8acea response_code = 200 uri = /vpc-routes
32892024-11-16T00:59:03.551ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {451b7f61-da91-4c83-9cfa-fd02c085d7b5: {10.151.2.175: {15e23569-5fe8-4f84-8517-2de97e5b9be1}, 10.151.2.176: {15e23569-5fe8-4f84-8517-2de97e5b9be1}}} }
32902024-11-16T00:59:03.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52438 req_id = b5cbea5f-560e-44c1-90ca-46385dbd4b12 response_code = 204 uri = /eip-gateways
32912024-11-16T00:59:03.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52438 req_id = 5b3802fc-240f-46e4-97f8-ca20c63ca13d response_code = 204 uri = /vpc-routes
32922024-11-16T00:59:10.045ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32932024-11-16T00:59:10.046ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32942024-11-16T00:59:10.047ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32952024-11-16T00:59:10.047ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32962024-11-16T00:59:10.048ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32972024-11-16T00:59:10.048ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32982024-11-16T00:59:10.049ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
32992024-11-16T00:59:10.050ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33002024-11-16T00:59:10.050ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33012024-11-16T00:59:10.051ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33022024-11-16T00:59:10.051ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33032024-11-16T00:59:10.052ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33042024-11-16T00:59:10.052ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33052024-11-16T00:59:10.053ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33062024-11-16T00:59:10.054ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33072024-11-16T00:59:10.054ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33082024-11-16T00:59:10.057ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33092024-11-16T00:59:10.057ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33102024-11-16T00:59:13.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49968
33112024-11-16T00:59:13.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 635 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49968 req_id = e1992bc0-ac87-45d7-9150-b475facf6454 response_code = 200 uri = /vmms/3385b93d-4ffb-4cac-a7a3-b2236ff37dc9/state
33122024-11-16T00:59:13.393ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-16T00:59:13.393571081Z } file = sled-agent/src/instance.rs:780 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
33132024-11-16T00:59:13.393ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-16T00:59:13.393571081Z } propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
33142024-11-16T00:59:13.393ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-16T00:59:13.393571081Z }, migration_in: None, migration_out: None }
33152024-11-16T00:59:13.405ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-16T00:59:13.405011091Z } file = sled-agent/src/instance.rs:780 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
33162024-11-16T00:59:13.405ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-16T00:59:13.405011091Z } propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
33172024-11-16T00:59:13.405ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
33182024-11-16T00:59:13.405ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
33192024-11-16T00:59:13.405ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 4894434347270799320 n_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33202024-11-16T00:59:13.405ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 1157124380241119525 n_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33212024-11-16T00:59:13.405ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
33222024-11-16T00:59:13.405ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/663efa11-5b34-43d6-b3ef-035ad0cb3d52/debug/bundle/zone", "/pool/int/cf590775-1e7e-4c57-848f-c6dd49cdc702/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/8dfb8147-eb55-4ee1-89a5-25b2d27c68ee/crypt/debug", "/pool/ext/d49e8c8c-eb53-43b6-a176-aee4725796df/crypt/debug", "/pool/ext/220cf814-be1b-400b-bb43-5ab45b7eb044/crypt/debug", "/pool/ext/b3e7398e-9645-46d0-a57a-4bd06e1408a3/crypt/debug", "/pool/ext/eb288506-11eb-4ffc-bf84-f6c1550028b7/crypt/debug", "/pool/ext/2df48cc0-997e-4c6b-92f6-f05e369b8ceb/crypt/debug", "/pool/ext/769d1181-4cb2-4e0f-87be-d1b20a8a9c58/crypt/debug", "/pool/ext/ad26846d-9efb-4f49-8d19-f73f5a25617e/crypt/debug", "/pool/ext/96d0d34c-625d-45e2-b0db-1fbc7541f944/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
33232024-11-16T00:59:13.912ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36756
33242024-11-16T00:59:13.913ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36756 req_id = 093958bb-f863-47f1-87ae-ec4c5b565b84 response_code = 200 uri = /baseboard
33252024-11-16T00:59:14.078ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9", bundle_id: a46f6a0b-faa3-4564-b744-4327ff47d7b3 }, time_created: 2024-11-16T00:59:13.405854084Z, version: 0, cause: TerminatedInstance }
33262024-11-16T00:59:14.078ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_3385b93d-4ffb-4cac-a7a3-b2236ff37dc9 file = sled-agent/src/instance.rs:1032 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
33272024-11-16T00:59:15.841ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
33282024-11-16T00:59:15.858ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(14993816), kind: System }
33292024-11-16T00:59:15.858ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(14993816), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
33302024-11-16T00:59:15.858ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-16T00:59:15.858952037Z }, migration_in: None, migration_out: None }
33312024-11-16T00:59:15.881ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-16T00:59:15.858952037Z }, migration_in: None, migration_out: None }
33322024-11-16T00:59:15.885ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 69efc63e-9f0d-44cd-a14f-4f5874e0cc00 propolis_id = 3385b93d-4ffb-4cac-a7a3-b2236ff37dc9
33332024-11-16T00:59:16.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61288
33342024-11-16T00:59:16.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61288 req_id = ef6532ef-e0b4-4f8b-b640-9950521f0e0e response_code = 200 uri = /vpc-routes
33352024-11-16T00:59:16.312ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
33362024-11-16T00:59:16.312ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1231 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33372024-11-16T00:59:16.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61288 req_id = bb27fe14-e61e-4594-99d3-65eebb82656e response_code = 204 uri = /eip-gateways
33382024-11-16T00:59:16.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61288 req_id = 86e4f72e-072e-44b6-9d82-0bb3eab7b65c response_code = 204 uri = /vpc-routes
33392024-11-16T00:59:16.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35468
33402024-11-16T00:59:16.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35468 req_id = 103a22ff-3fc3-4138-8aa7-bf9d06b661b7 response_code = 200 uri = /v2p
33412024-11-16T00:59:16.833ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54469
33422024-11-16T00:59:16.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54469 req_id = 1c955e97-f4ea-4ea9-9aa7-c5d15231c4d9 response_code = 200 uri = /v2p
33432024-11-16T00:59:16.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41032
33442024-11-16T00:59:16.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41032 req_id = 6b3b7f2b-10cd-4830-883c-80f7a61156af response_code = 200 uri = /vpc-routes
33452024-11-16T00:59:16.953ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
33462024-11-16T00:59:16.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41032 req_id = 04c8124a-b4b0-4660-a574-274cd3412415 response_code = 204 uri = /eip-gateways
33472024-11-16T00:59:16.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41032 req_id = 092a5f03-2beb-4994-a77b-42c2efe7fdc6 response_code = 204 uri = /vpc-routes
33482024-11-16T00:59:17.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36889
33492024-11-16T00:59:17.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36889 req_id = 8039a4a6-4b18-457b-99ad-e95a33feae66 response_code = 200 uri = /vpc-routes
33502024-11-16T00:59:17.679ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d values = ExternalIpGatewayMap { mappings: {} }
33512024-11-16T00:59:17.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36889 req_id = e1902f7b-5e2c-4a3d-808e-1dbf1ef088e2 response_code = 204 uri = /eip-gateways
33522024-11-16T00:59:17.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36889 req_id = 4367d864-845c-46e2-b240-f546b87305f1 response_code = 204 uri = /vpc-routes
33532024-11-16T00:59:20.048ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33542024-11-16T00:59:20.049ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33552024-11-16T00:59:20.050ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33562024-11-16T00:59:20.050ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33572024-11-16T00:59:20.052ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33582024-11-16T00:59:20.052ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33592024-11-16T00:59:20.053ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33602024-11-16T00:59:20.053ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33612024-11-16T00:59:20.054ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33622024-11-16T00:59:20.055ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33632024-11-16T00:59:20.055ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33642024-11-16T00:59:20.056ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33652024-11-16T00:59:20.056ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33662024-11-16T00:59:20.057ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33672024-11-16T00:59:20.057ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33682024-11-16T00:59:20.058ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33692024-11-16T00:59:20.060ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d
33702024-11-16T00:59:20.061ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ad7c66bd-0d53-43e9-89e8-86e0651ea05d