Max level shown:
1 [ Jan 14 22:27:33 Enabled. ]
2 [ Jan 14 22:27:33 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jan 14 22:27:33 Method "start" exited with status 0. ]
4 [ Jan 14 22:27:33 Rereading configuration. ]
5 [ Jan 14 22:27:33 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-01-14T22:27:33.392ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-01-14T22:27:33.392ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-01-14T22:27:33.445ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-01-14T22:27:33.445ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-01-14T22:27:33.559ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-01-14T22:27:33.568ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-01-14T22:27:33.576ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-01-14T22:27:34.175ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152025-01-14T22:27:34.313ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-01-14T22:27:34.313ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-01-14T22:27:34.313ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-01-14T22:27:34.314ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
192025-01-14T22:27:34.314ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
202025-01-14T22:27:34.314ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212025-01-14T22:27:34.316ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-01-14T22:27:34.316ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-01-14T22:27:34.316ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-01-14T22:27:34.316ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-01-14T22:27:34.316ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-01-14T22:27:34.317ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-01-14T22:27:34.317ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-01-14T22:27:34.317ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-01-14T22:27:34.317ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-01-14T22:27:34.328ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-01-14T22:27:34.328ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = f8623b78-d620-46da-9ac6-8ccbfd340e73 (zpool)
322025-01-14T22:27:34.428ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f8623b78-d620-46da-9ac6-8ccbfd340e73 (zpool), kind: Internal }
332025-01-14T22:27:34.791ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-01-14T22:27:34.792ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-01-14T22:27:34.792ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-01-14T22:27:34.792ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-01-14T22:27:34.792ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-01-14T22:27:34.792ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-01-14T22:27:34.792ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-01-14T22:27:34.801ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-01-14T22:27:34.801ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = ecf20bd2-553d-4a86-bee6-6b66419f2aa7 (zpool)
422025-01-14T22:27:34.888ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ecf20bd2-553d-4a86-bee6-6b66419f2aa7 (zpool), kind: Internal }
432025-01-14T22:27:35.248ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-01-14T22:27:35.248ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f8623b78-d620-46da-9ac6-8ccbfd340e73 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ecf20bd2-553d-4a86-bee6-6b66419f2aa7 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-01-14T22:27:35.248ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-01-14T22:27:35.248ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472025-01-14T22:27:35.248ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482025-01-14T22:27:35.248ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-01-14T22:27:35.248ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-01-14T22:27:35.248ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f8623b78-d620-46da-9ac6-8ccbfd340e73 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ecf20bd2-553d-4a86-bee6-6b66419f2aa7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-01-14T22:27:35.248ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522025-01-14T22:27:35.248ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
532025-01-14T22:27:35.248ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
542025-01-14T22:27:35.248ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552025-01-14T22:27:35.248ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-01-14T22:27:35.248ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f8623b78-d620-46da-9ac6-8ccbfd340e73 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ecf20bd2-553d-4a86-bee6-6b66419f2aa7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-01-14T22:27:35.248ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582025-01-14T22:27:35.248ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
592025-01-14T22:27:35.248ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
602025-01-14T22:27:35.248ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-01-14T22:27:35.248ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-01-14T22:27:35.248ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
632025-01-14T22:27:35.248ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
642025-01-14T22:27:35.248ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f8623b78-d620-46da-9ac6-8ccbfd340e73 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ecf20bd2-553d-4a86-bee6-6b66419f2aa7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
652025-01-14T22:27:35.248ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662025-01-14T22:27:35.248ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672025-01-14T22:27:35.248ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-01-14T22:27:35.248ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f8623b78-d620-46da-9ac6-8ccbfd340e73 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ecf20bd2-553d-4a86-bee6-6b66419f2aa7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-01-14T22:27:35.248ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
702025-01-14T22:27:35.248ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
712025-01-14T22:27:35.248ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
722025-01-14T22:27:35.248ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
732025-01-14T22:27:35.248ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-01-14T22:27:35.248ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f8623b78-d620-46da-9ac6-8ccbfd340e73 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ecf20bd2-553d-4a86-bee6-6b66419f2aa7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-01-14T22:27:35.248ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-01-14T22:27:35.248ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-01-14T22:27:35.248ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-01-14T22:27:35.248ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-01-14T22:27:35.248ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-01-14T22:27:35.248ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f8623b78-d620-46da-9ac6-8ccbfd340e73 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ecf20bd2-553d-4a86-bee6-6b66419f2aa7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812025-01-14T22:27:35.248ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822025-01-14T22:27:35.248ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832025-01-14T22:27:35.249ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
842025-01-14T22:27:35.249ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852025-01-14T22:27:35.249ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-01-14T22:27:35.249ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872025-01-14T22:27:35.249ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882025-01-14T22:27:35.249ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
892025-01-14T22:27:35.249ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f8623b78-d620-46da-9ac6-8ccbfd340e73 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ecf20bd2-553d-4a86-bee6-6b66419f2aa7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
902025-01-14T22:27:35.249ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
912025-01-14T22:27:35.249ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
922025-01-14T22:27:35.249ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
932025-01-14T22:27:35.249ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942025-01-14T22:27:35.249ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
952025-01-14T22:27:35.249ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
962025-01-14T22:27:35.249ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f8623b78-d620-46da-9ac6-8ccbfd340e73 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ecf20bd2-553d-4a86-bee6-6b66419f2aa7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
972025-01-14T22:27:35.249ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
982025-01-14T22:27:35.249ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
992025-01-14T22:27:35.249ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1002025-01-14T22:27:35.249ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f8623b78-d620-46da-9ac6-8ccbfd340e73 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ecf20bd2-553d-4a86-bee6-6b66419f2aa7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012025-01-14T22:27:35.249ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022025-01-14T22:27:35.249ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1032025-01-14T22:27:35.249ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1042025-01-14T22:27:35.249ZINFOSledAgent (bootstore): No ledger in /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052025-01-14T22:27:35.249ZINFOSledAgent (bootstore): No ledger in /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062025-01-14T22:27:35.249ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072025-01-14T22:27:35.249ZINFOSledAgent (bootstore): No ledger in /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082025-01-14T22:27:35.249ZINFOSledAgent (bootstore): No ledger in /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092025-01-14T22:27:35.249ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102025-01-14T22:27:35.249ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-01-14T22:27:35.249ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-01-14T22:27:35.260ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:748
1132025-01-14T22:27:35.260ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1462, tv_nsec: 443248291 } time_to_next_cleanup = 599.9999449s
1142025-01-14T22:27:35.260ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3973
1152025-01-14T22:27:35.260ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-01-14T22:27:35.262ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-01-14T22:27:35.263ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-01-14T22:27:35.263ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192025-01-14T22:27:35.265ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202025-01-14T22:27:35.265ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1204
1212025-01-14T22:27:35.265ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-01-14T22:27:35.265ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-01-14T22:27:35.265ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-01-14T22:27:35.265ZINFOSledAgent (RSS): No ledger in /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/rss-started.marker file = common/src/ledger.rs:188
1252025-01-14T22:27:35.265ZINFOSledAgent (RSS): No ledger in /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/rss-started.marker file = common/src/ledger.rs:188
1262025-01-14T22:27:35.265ZINFOSledAgent (RSS): No ledger in /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-01-14T22:27:35.265ZINFOSledAgent (RSS): No ledger in /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-01-14T22:27:35.265ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1253
1292025-01-14T22:27:35.265ZINFOSledAgent (RSS): Writing ledger to /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-01-14T22:27:35.265ZINFOSledAgent (RSS): Writing ledger to /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-01-14T22:27:35.266ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1285
1322025-01-14T22:27:35.266ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-01-14T22:27:35.266ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-01-14T22:27:35.266ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352025-01-14T22:27:35.266ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1362025-01-14T22:27:35.266ZINFOSledAgent (bootstore): Writing ledger to /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1372025-01-14T22:27:35.266ZINFOSledAgent (bootstore): Writing ledger to /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1382025-01-14T22:27:35.266ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1392025-01-14T22:27:35.266ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 652f7dd4-af0c-42f1-b515-fb2bf74375f9 (sled), rack_id: e46a19d5-4ebb-4613-bf07-7717ce8f3a2e, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1402025-01-14T22:27:35.267ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4270
1412025-01-14T22:27:35.267ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4664
1422025-01-14T22:27:35.271ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432025-01-14T22:27:35.276ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442025-01-14T22:27:35.276ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452025-01-14T22:27:35.281ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462025-01-14T22:27:35.281ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472025-01-14T22:27:35.281ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:35939
1482025-01-14T22:27:35.281ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 652f7dd4-af0c-42f1-b515-fb2bf74375f9 (sled), rack_id: e46a19d5-4ebb-4613-bf07-7717ce8f3a2e, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492025-01-14T22:27:35.281ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502025-01-14T22:27:35.281ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-01-14T22:27:35.281ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1522025-01-14T22:27:35.281ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1532025-01-14T22:27:35.281ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-01-14T22:27:35.281ZINFOSledAgent (StorageManager): No ledger in /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552025-01-14T22:27:35.281ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1562025-01-14T22:27:35.281ZINFOSledAgent (StorageManager): No ledger in /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-01-14T22:27:35.281ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-01-14T22:27:35.281ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-01-14T22:27:35.281ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-01-14T22:27:35.281ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-01-14T22:27:35.281ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-01-14T22:27:35.296ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-01-14T22:27:35.314ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-01-14T22:27:35.331ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-01-14T22:27:35.334ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:412 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
1662025-01-14T22:27:35.334ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-01-14T22:27:35.334ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:424 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
1682025-01-14T22:27:35.334ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692025-01-14T22:27:35.338ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 99.087038ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ec9124e0-0178-4dcc-92b1-3ec8d9c52b75", "content-length": "124", "date": "Tue, 14 Jan 2025 22:27:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ec9124e0-0178-4dcc-92b1-3ec8d9c52b75" } file = clients/ddm-admin-client/src/lib.rs:177
1702025-01-14T22:27:35.348ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_f8623b78-d620-46da-9ac6-8ccbfd340e73/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-01-14T22:27:35.371ZINFOSledAgent: successfully created encrypted zvol: name="oxi_f8623b78-d620-46da-9ac6-8ccbfd340e73/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-01-14T22:27:35.372ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_f8623b78-d620-46da-9ac6-8ccbfd340e73/swap" file = sled-agent/src/swap_device.rs:96
1732025-01-14T22:27:35.376ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:439 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
1742025-01-14T22:27:35.376ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-01-14T22:27:35.376ZINFOSledAgent (BackingFs): Ensuring dataset oxi_f8623b78-d620-46da-9ac6-8ccbfd340e73/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-01-14T22:27:35.439ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772025-01-14T22:27:35.439ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 81.908206ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "68eb656c-09ec-4142-8b6f-60a0422a776b", "content-length": "124", "date": "Tue, 14 Jan 2025 22:27:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "68eb656c-09ec-4142-8b6f-60a0422a776b" } file = clients/ddm-admin-client/src/lib.rs:177
1782025-01-14T22:27:35.446ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792025-01-14T22:27:35.523ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802025-01-14T22:27:35.523ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 214.29952ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "43534741-09b5-4131-822c-1a1e7a6e19eb", "content-length": "124", "date": "Tue, 14 Jan 2025 22:27:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "43534741-09b5-4131-822c-1a1e7a6e19eb" } file = clients/ddm-admin-client/src/lib.rs:177
1812025-01-14T22:27:35.666ZINFOSledAgent (BackingFs): Mounting oxi_f8623b78-d620-46da-9ac6-8ccbfd340e73/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-01-14T22:27:35.678ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-01-14T22:27:35.678ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-01-14T22:27:35.678ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-01-14T22:27:35.678ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-01-14T22:27:35.738ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872025-01-14T22:27:35.739ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 233.390699ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d66177dc-28ae-4a49-acae-596f790effcf", "content-length": "124", "date": "Tue, 14 Jan 2025 22:27:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d66177dc-28ae-4a49-acae-596f790effcf" } file = clients/ddm-admin-client/src/lib.rs:177
1882025-01-14T22:27:35.973ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892025-01-14T22:27:35.974ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 111.756042ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5b8eb91a-e03e-4590-996f-e44516f3df3f", "content-length": "124", "date": "Tue, 14 Jan 2025 22:27:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5b8eb91a-e03e-4590-996f-e44516f3df3f" } file = clients/ddm-admin-client/src/lib.rs:177
1902025-01-14T22:27:36.086ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-01-14T22:27:36.086ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 330.32046ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "97c80d48-78cd-40d9-ad5c-8b97ba197b0f", "content-length": "124", "date": "Tue, 14 Jan 2025 22:27:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "97c80d48-78cd-40d9-ad5c-8b97ba197b0f" } file = clients/ddm-admin-client/src/lib.rs:177
1922025-01-14T22:27:36.418ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932025-01-14T22:27:36.420ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
1942025-01-14T22:27:36.425ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:50816 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
1952025-01-14T22:27:36.425ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
1962025-01-14T22:27:36.425ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:50816 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
1972025-01-14T22:27:36.426ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 238.608757ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
1982025-01-14T22:27:36.428ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
1992025-01-14T22:27:36.428ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
2002025-01-14T22:27:36.428ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:932 underlay_address = fd00:1122:3344:101::1
2012025-01-14T22:27:36.428ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2022025-01-14T22:27:36.667ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 623.022759ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
2032025-01-14T22:27:37.292ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 985.853746ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
2042025-01-14T22:27:38.280ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.295111111s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
2052025-01-14T22:27:38.983ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2694
2062025-01-14T22:27:38.983ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2939
2072025-01-14T22:27:38.983ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2564
2082025-01-14T22:27:38.983ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2611
2092025-01-14T22:27:38.983ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3020
2102025-01-14T22:27:38.983ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3065
2112025-01-14T22:27:38.985ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2864
2122025-01-14T22:27:38.987ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2605
2132025-01-14T22:27:38.987ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='e1958e4b-d939-4240-8155-bf67792c9631'/> <propval type="astring" name="rack_id" value='e46a19d5-4ebb-4613-bf07-7717ce8f3a2e'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe22:9134'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='e46a19d5-4ebb-4613-bf07-7717ce8f3a2e'/> <propval type="astring" name="sled_id" value='652f7dd4-af0c-42f1-b515-fb2bf74375f9'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='652f7dd4-af0c-42f1-b515-fb2bf74375f9'/> <propval type="astring" name="rack_uuid" value='e46a19d5-4ebb-4613-bf07-7717ce8f3a2e'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='652f7dd4-af0c-42f1-b515-fb2bf74375f9'/> <propval type="astring" name="rack_uuid" value='e46a19d5-4ebb-4613-bf07-7717ce8f3a2e'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2142025-01-14T22:27:38.987ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2152025-01-14T22:27:39.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 51.724909ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2162025-01-14T22:27:39.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 60.200751ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2172025-01-14T22:27:39.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 224.86184ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182025-01-14T22:27:39.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 466.06055ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192025-01-14T22:27:40.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.120648291s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202025-01-14T22:27:40.577ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.071709559s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
2212025-01-14T22:27:41.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 897.363384ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222025-01-14T22:27:42.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 901.381143ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232025-01-14T22:27:43.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 649.221041ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242025-01-14T22:27:44.846ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 9.265608245s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
2252025-01-14T22:27:44.852ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/652f7dd4-af0c-42f1-b515-fb2bf74375f9) file = sled-agent/src/nexus.rs:527 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
2262025-01-14T22:27:44.882ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2272025-01-14T22:27:44.883ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
2282025-01-14T22:27:44.884ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2292025-01-14T22:27:44.884ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2302025-01-14T22:27:44.884ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2312025-01-14T22:27:44.884ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2322025-01-14T22:27:44.885ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332025-01-14T22:27:44.885ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2342025-01-14T22:27:44.885ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2352025-01-14T22:27:44.885ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3973
2362025-01-14T22:27:44.885ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:35939
2372025-01-14T22:27:45.090ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2382025-01-14T22:27:45.090ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2392025-01-14T22:27:45.096ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4294 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2402025-01-14T22:27:46.082ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/652f7dd4-af0c-42f1-b515-fb2bf74375f9) file = sled-agent/src/probe_manager.rs:231 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
2412025-01-14T22:27:46.084ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51962
2422025-01-14T22:27:46.084ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2432025-01-14T22:27:46.084ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2442025-01-14T22:27:46.084ZINFOSledAgent (ServiceManager): No ledger in /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/omicron-zones.json file = common/src/ledger.rs:188
2452025-01-14T22:27:46.084ZINFOSledAgent (ServiceManager): No ledger in /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/omicron-zones.json file = common/src/ledger.rs:188
2462025-01-14T22:27:46.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51962 req_id = bf8f6c57-7d9a-4739-8986-2ee90fc27b16 response_code = 200 uri = /inventory
2472025-01-14T22:27:46.305ZINFOSledAgent (ServiceManager): refreshed zone-network-setup service with new configuration file = sled-agent/src/services.rs:4343
2482025-01-14T22:27:46.305ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4401
2492025-01-14T22:27:46.563ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1371723932291147185 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
2502025-01-14T22:27:46.563ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6903098002638956888 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
2512025-01-14T22:27:46.815ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
2522025-01-14T22:27:46.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50752
2532025-01-14T22:27:46.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50752 req_id = 039b68a3-5fef-4510-8a30-779e0b10832e response_code = 200 uri = /sled-role
2542025-01-14T22:27:46.858ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 9496dda3-1325-4f97-b488-67e28590037f (physical_disk), pool_id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 9afc1f21-b24e-4760-8155-1ed59213627e (physical_disk), pool_id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: a23a1a7c-7e87-472e-a83d-8376c62b082f (physical_disk), pool_id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 1782bde0-e6f4-4854-9766-4856ec254340 (physical_disk), pool_id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 28349408-c304-46d5-9b7f-59941be094b8 (physical_disk), pool_id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 678d781a-59e9-4843-973c-071a3f459aca (physical_disk), pool_id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 6a261fd4-5c78-4907-b259-81092486049a (physical_disk), pool_id: a77abd92-fef1-4271-b3d6-7b70ec3d579b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 45249abe-6b04-4a90-8e13-408602b0b361 (physical_disk), pool_id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: ff4898d8-abfd-4d6b-bcd0-1f3a611f5df9 (physical_disk), pool_id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2552025-01-14T22:27:46.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39648
2562025-01-14T22:27:46.859ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:893 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
2572025-01-14T22:27:46.859ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 9496dda3-1325-4f97-b488-67e28590037f (physical_disk), pool_id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 9afc1f21-b24e-4760-8155-1ed59213627e (physical_disk), pool_id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: a23a1a7c-7e87-472e-a83d-8376c62b082f (physical_disk), pool_id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 1782bde0-e6f4-4854-9766-4856ec254340 (physical_disk), pool_id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 28349408-c304-46d5-9b7f-59941be094b8 (physical_disk), pool_id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 678d781a-59e9-4843-973c-071a3f459aca (physical_disk), pool_id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 6a261fd4-5c78-4907-b259-81092486049a (physical_disk), pool_id: a77abd92-fef1-4271-b3d6-7b70ec3d579b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 45249abe-6b04-4a90-8e13-408602b0b361 (physical_disk), pool_id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: ff4898d8-abfd-4d6b-bcd0-1f3a611f5df9 (physical_disk), pool_id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2582025-01-14T22:27:46.859ZINFOSledAgent (StorageManager): No ledger in /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2592025-01-14T22:27:46.859ZINFOSledAgent (StorageManager): No ledger in /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2602025-01-14T22:27:46.859ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2612025-01-14T22:27:46.859ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2622025-01-14T22:27:46.859ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2632025-01-14T22:27:46.859ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2642025-01-14T22:27:46.859ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2652025-01-14T22:27:46.870ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2662025-01-14T22:27:46.870ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool)
2672025-01-14T22:27:46.969ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }
2682025-01-14T22:27:46.977ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2692025-01-14T22:27:46.977ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2702025-01-14T22:27:46.977ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2712025-01-14T22:27:46.977ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2722025-01-14T22:27:46.977ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2732025-01-14T22:27:46.977ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2742025-01-14T22:27:46.977ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2752025-01-14T22:27:47.012ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2762025-01-14T22:27:47.021ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8/crypt/zone file = sled-storage/src/dataset.rs:302
2772025-01-14T22:27:47.084ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/652f7dd4-af0c-42f1-b515-fb2bf74375f9) file = sled-agent/src/probe_manager.rs:231 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
2782025-01-14T22:27:47.161ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 file = sled-storage/src/dataset.rs:388
2792025-01-14T22:27:47.169ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2802025-01-14T22:27:47.169ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2812025-01-14T22:27:47.169ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2822025-01-14T22:27:47.169ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2832025-01-14T22:27:47.169ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2842025-01-14T22:27:47.179ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2852025-01-14T22:27:47.179ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool)
2862025-01-14T22:27:47.269ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }
2872025-01-14T22:27:47.276ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2882025-01-14T22:27:47.277ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2892025-01-14T22:27:47.277ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2902025-01-14T22:27:47.277ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2912025-01-14T22:27:47.277ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2922025-01-14T22:27:47.277ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2932025-01-14T22:27:47.277ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2942025-01-14T22:27:47.311ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2952025-01-14T22:27:47.319ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_17026a0f-546c-4e8b-87e1-2bef866e5f38/crypt/zone file = sled-storage/src/dataset.rs:302
2962025-01-14T22:27:47.457ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_17026a0f-546c-4e8b-87e1-2bef866e5f38 file = sled-storage/src/dataset.rs:388
2972025-01-14T22:27:47.466ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2982025-01-14T22:27:47.466ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2992025-01-14T22:27:47.466ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3002025-01-14T22:27:47.466ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3012025-01-14T22:27:47.466ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3022025-01-14T22:27:47.476ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3032025-01-14T22:27:47.476ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool)
3042025-01-14T22:27:47.568ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }
3052025-01-14T22:27:47.577ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3062025-01-14T22:27:47.577ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3072025-01-14T22:27:47.577ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3082025-01-14T22:27:47.577ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3092025-01-14T22:27:47.577ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102025-01-14T22:27:47.577ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112025-01-14T22:27:47.577ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3122025-01-14T22:27:47.612ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3132025-01-14T22:27:47.620ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_193d38c2-fbe5-4b1d-95c5-92a256ddffe2/crypt/zone file = sled-storage/src/dataset.rs:302
3142025-01-14T22:27:47.759ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_193d38c2-fbe5-4b1d-95c5-92a256ddffe2 file = sled-storage/src/dataset.rs:388
3152025-01-14T22:27:47.768ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3162025-01-14T22:27:47.768ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3172025-01-14T22:27:47.768ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3182025-01-14T22:27:47.768ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3192025-01-14T22:27:47.768ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3202025-01-14T22:27:47.778ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3212025-01-14T22:27:47.778ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool)
3222025-01-14T22:27:47.872ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }
3232025-01-14T22:27:47.881ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3242025-01-14T22:27:47.881ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3252025-01-14T22:27:47.881ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3262025-01-14T22:27:47.881ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3272025-01-14T22:27:47.881ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282025-01-14T22:27:47.881ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3292025-01-14T22:27:47.881ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3302025-01-14T22:27:47.919ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3312025-01-14T22:27:47.927ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f72d9943-3b41-40fd-968b-8debb9d0e66b/crypt/zone file = sled-storage/src/dataset.rs:302
3322025-01-14T22:27:48.066ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f72d9943-3b41-40fd-968b-8debb9d0e66b file = sled-storage/src/dataset.rs:388
3332025-01-14T22:27:48.074ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3342025-01-14T22:27:48.074ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3352025-01-14T22:27:48.074ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3362025-01-14T22:27:48.074ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3372025-01-14T22:27:48.074ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3382025-01-14T22:27:48.084ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3392025-01-14T22:27:48.084ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool)
3402025-01-14T22:27:48.178ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }
3412025-01-14T22:27:48.187ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3422025-01-14T22:27:48.187ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3432025-01-14T22:27:48.188ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3442025-01-14T22:27:48.188ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3452025-01-14T22:27:48.188ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3462025-01-14T22:27:48.188ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472025-01-14T22:27:48.188ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3482025-01-14T22:27:48.192ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/652f7dd4-af0c-42f1-b515-fb2bf74375f9) file = sled-agent/src/probe_manager.rs:231 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
3492025-01-14T22:27:48.223ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3502025-01-14T22:27:48.231ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ebeecaa7-8727-491c-81b6-8ff8177ba2c6/crypt/zone file = sled-storage/src/dataset.rs:302
3512025-01-14T22:27:48.366ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ebeecaa7-8727-491c-81b6-8ff8177ba2c6 file = sled-storage/src/dataset.rs:388
3522025-01-14T22:27:48.374ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3532025-01-14T22:27:48.374ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3542025-01-14T22:27:48.374ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3552025-01-14T22:27:48.374ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3562025-01-14T22:27:48.374ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3572025-01-14T22:27:48.384ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3582025-01-14T22:27:48.384ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool)
3592025-01-14T22:27:48.477ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External }
3602025-01-14T22:27:48.484ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3612025-01-14T22:27:48.484ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3622025-01-14T22:27:48.484ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3632025-01-14T22:27:48.484ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3642025-01-14T22:27:48.484ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652025-01-14T22:27:48.484ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662025-01-14T22:27:48.484ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3672025-01-14T22:27:48.520ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3682025-01-14T22:27:48.528ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_489724fa-785f-4f35-bb0f-34adf6a09482/crypt/zone file = sled-storage/src/dataset.rs:302
3692025-01-14T22:27:48.662ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_489724fa-785f-4f35-bb0f-34adf6a09482 file = sled-storage/src/dataset.rs:388
3702025-01-14T22:27:48.670ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3712025-01-14T22:27:48.670ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3722025-01-14T22:27:48.670ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3732025-01-14T22:27:48.670ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3742025-01-14T22:27:48.670ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3752025-01-14T22:27:48.680ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3762025-01-14T22:27:48.680ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a77abd92-fef1-4271-b3d6-7b70ec3d579b (zpool)
3772025-01-14T22:27:48.778ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a77abd92-fef1-4271-b3d6-7b70ec3d579b (zpool), kind: External }
3782025-01-14T22:27:48.785ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3792025-01-14T22:27:48.785ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3802025-01-14T22:27:48.785ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3812025-01-14T22:27:48.785ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3822025-01-14T22:27:48.785ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832025-01-14T22:27:48.785ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842025-01-14T22:27:48.785ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3852025-01-14T22:27:48.821ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3862025-01-14T22:27:48.828ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a77abd92-fef1-4271-b3d6-7b70ec3d579b/crypt/zone file = sled-storage/src/dataset.rs:302
3872025-01-14T22:27:48.960ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a77abd92-fef1-4271-b3d6-7b70ec3d579b file = sled-storage/src/dataset.rs:388
3882025-01-14T22:27:48.967ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3892025-01-14T22:27:48.967ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3902025-01-14T22:27:48.967ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3912025-01-14T22:27:48.967ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3922025-01-14T22:27:48.967ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3932025-01-14T22:27:48.977ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3942025-01-14T22:27:48.978ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool)
3952025-01-14T22:27:49.076ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool), kind: External }
3962025-01-14T22:27:49.084ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3972025-01-14T22:27:49.084ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3982025-01-14T22:27:49.084ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
3992025-01-14T22:27:49.084ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4002025-01-14T22:27:49.084ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4012025-01-14T22:27:49.084ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4022025-01-14T22:27:49.084ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4032025-01-14T22:27:49.119ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4042025-01-14T22:27:49.127ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59/crypt/zone file = sled-storage/src/dataset.rs:302
4052025-01-14T22:27:49.197ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/652f7dd4-af0c-42f1-b515-fb2bf74375f9) file = sled-agent/src/probe_manager.rs:231 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
4062025-01-14T22:27:49.265ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 file = sled-storage/src/dataset.rs:388
4072025-01-14T22:27:49.273ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4082025-01-14T22:27:49.273ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4092025-01-14T22:27:49.273ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4102025-01-14T22:27:49.273ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4112025-01-14T22:27:49.273ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4122025-01-14T22:27:49.282ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4132025-01-14T22:27:49.282ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool)
4142025-01-14T22:27:49.395ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool), kind: External }
4152025-01-14T22:27:49.403ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4162025-01-14T22:27:49.403ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4172025-01-14T22:27:49.403ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4182025-01-14T22:27:49.403ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4192025-01-14T22:27:49.403ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202025-01-14T22:27:49.403ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4212025-01-14T22:27:49.403ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4222025-01-14T22:27:49.437ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4232025-01-14T22:27:49.446ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_42c887d6-10d1-4b8b-a7bb-82239cc2998c/crypt/zone file = sled-storage/src/dataset.rs:302
4242025-01-14T22:27:49.581ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_42c887d6-10d1-4b8b-a7bb-82239cc2998c file = sled-storage/src/dataset.rs:388
4252025-01-14T22:27:49.590ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4262025-01-14T22:27:49.590ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4272025-01-14T22:27:49.590ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4282025-01-14T22:27:49.590ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f8623b78-d620-46da-9ac6-8ccbfd340e73 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ecf20bd2-553d-4a86-bee6-6b66419f2aa7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a77abd92-fef1-4271-b3d6-7b70ec3d579b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4292025-01-14T22:27:49.590ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4302025-01-14T22:27:49.590ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4312025-01-14T22:27:49.591ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4322025-01-14T22:27:49.591ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:897 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
4332025-01-14T22:27:49.591ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4342025-01-14T22:27:49.591ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:923 generation = Generation(2) sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
4352025-01-14T22:27:49.591ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:928 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
4362025-01-14T22:27:49.591ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:933 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
4372025-01-14T22:27:49.591ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
4382025-01-14T22:27:49.591ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:939 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
4392025-01-14T22:27:49.591ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4402025-01-14T22:27:49.591ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:944 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
4412025-01-14T22:27:49.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2732302 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39648 req_id = b85c5e15-7f9d-4f42-afc1-920655fc7ae2 response_code = 200 uri = /omicron-physical-disks
4422025-01-14T22:27:49.623ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {04eacc05-1a60-4e79-be53-56a033bcf609 (dataset): DatasetConfig { id: 04eacc05-1a60-4e79-be53-56a033bcf609 (dataset), name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 07a81dba-5867-41bc-a525-8dec84b31076 (dataset): DatasetConfig { id: 07a81dba-5867-41bc-a525-8dec84b31076 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0e87bd4c-d6ea-490f-9b32-62be16f18c21 (dataset): DatasetConfig { id: 0e87bd4c-d6ea-490f-9b32-62be16f18c21 (dataset), name: DatasetName { pool_name: ZpoolName { id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0eafa25d-7f60-4d1b-8534-11118bdfffa9 (dataset): DatasetConfig { id: 0eafa25d-7f60-4d1b-8534-11118bdfffa9 (dataset), name: DatasetName { pool_name: ZpoolName { id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 11ee8476-b251-4fd0-a72c-f1ace4a6329a (dataset): DatasetConfig { id: 11ee8476-b251-4fd0-a72c-f1ace4a6329a (dataset), name: DatasetName { pool_name: ZpoolName { id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 183edf54-32e2-45c6-b9ea-dba85f0a74d6 (dataset): DatasetConfig { id: 183edf54-32e2-45c6-b9ea-dba85f0a74d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c2660bc-d76f-481c-8282-b05fd0b25301 (dataset): DatasetConfig { id: 1c2660bc-d76f-481c-8282-b05fd0b25301 (dataset), name: DatasetName { pool_name: ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1fa66e7f-d834-4568-9911-20badf1f391e (dataset): DatasetConfig { id: 1fa66e7f-d834-4568-9911-20badf1f391e (dataset), name: DatasetName { pool_name: ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23144b2a-42e0-464d-b652-b3d9830e6ac9 (dataset): DatasetConfig { id: 23144b2a-42e0-464d-b652-b3d9830e6ac9 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 276ddb2b-37d6-4a86-a798-7840e1f3c9bb (dataset): DatasetConfig { id: 276ddb2b-37d6-4a86-a798-7840e1f3c9bb (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 296c813f-4708-4e6e-841b-f2aa1ee98b56 (dataset): DatasetConfig { id: 296c813f-4708-4e6e-841b-f2aa1ee98b56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 297d1e54-41c5-4d95-a729-592d542cd8eb (dataset): DatasetConfig { id: 297d1e54-41c5-4d95-a729-592d542cd8eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 31bccae8-0f03-4c70-8941-db9ecb728df4 (dataset): DatasetConfig { id: 31bccae8-0f03-4c70-8941-db9ecb728df4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 352cfb99-03ce-40aa-85b7-8480ff1d44a9 (dataset): DatasetConfig { id: 352cfb99-03ce-40aa-85b7-8480ff1d44a9 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3595c016-e15b-4252-b89b-d431f2d9abe0 (dataset): DatasetConfig { id: 3595c016-e15b-4252-b89b-d431f2d9abe0 (dataset), name: DatasetName { pool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a0ee884-b7fe-47d2-add1-f7d5db43cbff (dataset): DatasetConfig { id: 3a0ee884-b7fe-47d2-add1-f7d5db43cbff (dataset), name: DatasetName { pool_name: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3b756d70-8244-424a-bfa1-dc397fe4740a (dataset): DatasetConfig { id: 3b756d70-8244-424a-bfa1-dc397fe4740a (dataset), name: DatasetName { pool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d309ec6-872f-4bc3-8731-7c687f231e52 (dataset): DatasetConfig { id: 3d309ec6-872f-4bc3-8731-7c687f231e52 (dataset), name: DatasetName { pool_name: ZpoolName { id: a77abd92-fef1-4271-b3d6-7b70ec3d579b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4206258a-1540-4b8b-a111-04a11b9efdb0 (dataset): DatasetConfig { id: 4206258a-1540-4b8b-a111-04a11b9efdb0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 430c466a-17aa-4673-9f5e-08915ac4af22 (dataset): DatasetConfig { id: 430c466a-17aa-4673-9f5e-08915ac4af22 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 480e14e5-2fba-4f56-af54-ebc415954c0a (dataset): DatasetConfig { id: 480e14e5-2fba-4f56-af54-ebc415954c0a (dataset), name: DatasetName { pool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 486c4c15-6583-40d9-8192-eb946b97b95a (dataset): DatasetConfig { id: 486c4c15-6583-40d9-8192-eb946b97b95a (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 50134607-3ca3-4dfa-8ecd-ef72a230d1bb (dataset): DatasetConfig { id: 50134607-3ca3-4dfa-8ecd-ef72a230d1bb (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5364a615-b65a-4d0e-8e03-c67edd26a7fd (dataset): DatasetConfig { id: 5364a615-b65a-4d0e-8e03-c67edd26a7fd (dataset), name: DatasetName { pool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5e188fd1-410f-4235-bb17-2ad0baf95a3a (dataset): DatasetConfig { id: 5e188fd1-410f-4235-bb17-2ad0baf95a3a (dataset), name: DatasetName { pool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5ec4057a-5832-4377-9b6c-7110d830b0f5 (dataset): DatasetConfig { id: 5ec4057a-5832-4377-9b6c-7110d830b0f5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6cf96fb6-a9d8-47fe-b787-c8c14f683a33 (dataset): DatasetConfig { id: 6cf96fb6-a9d8-47fe-b787-c8c14f683a33 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 75bf051c-33ee-4451-97b9-6c8d7fd03a01 (dataset): DatasetConfig { id: 75bf051c-33ee-4451-97b9-6c8d7fd03a01 (dataset), name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 76367241-9315-4d40-9738-f1b472870007 (dataset): DatasetConfig { id: 76367241-9315-4d40-9738-f1b472870007 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 771bd8c2-d28b-414f-9fef-913ec985aba6 (dataset): DatasetConfig { id: 771bd8c2-d28b-414f-9fef-913ec985aba6 (dataset), name: DatasetName { pool_name: ZpoolName { id: a77abd92-fef1-4271-b3d6-7b70ec3d579b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7bc531bc-0b1a-4e5f-874f-35454c71316e (dataset): DatasetConfig { id: 7bc531bc-0b1a-4e5f-874f-35454c71316e (dataset), name: DatasetName { pool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7cafcae6-1a7c-425c-9650-e5a5220be343 (dataset): DatasetConfig { id: 7cafcae6-1a7c-425c-9650-e5a5220be343 (dataset), name: DatasetName { pool_name: ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e30b587-dd3c-436f-8f19-4f757cca8b47 (dataset): DatasetConfig { id: 7e30b587-dd3c-436f-8f19-4f757cca8b47 (dataset), name: DatasetName { pool_name: ZpoolName { id: a77abd92-fef1-4271-b3d6-7b70ec3d579b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 850179ce-4388-4d9e-ab9a-74ae8e431b66 (dataset): DatasetConfig { id: 850179ce-4388-4d9e-ab9a-74ae8e431b66 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85449589-808f-40c5-ada0-432eaa7a8bf5 (dataset): DatasetConfig { id: 85449589-808f-40c5-ada0-432eaa7a8bf5 (dataset), name: DatasetName { pool_name: ZpoolName { id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85b09fb6-70d9-4009-a17d-528f5e6fe335 (dataset): DatasetConfig { id: 85b09fb6-70d9-4009-a17d-528f5e6fe335 (dataset), name: DatasetName { pool_name: ZpoolName { id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8872f12a-21f5-46af-880e-df6f5545fc0f (dataset): DatasetConfig { id: 8872f12a-21f5-46af-880e-df6f5545fc0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8d4bf125-f8f8-47bf-b085-e53b5a120bdd (dataset): DatasetConfig { id: 8d4bf125-f8f8-47bf-b085-e53b5a120bdd (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9086164d-9334-4b72-8418-bc13b8b85e5f (dataset): DatasetConfig { id: 9086164d-9334-4b72-8418-bc13b8b85e5f (dataset), name: DatasetName { pool_name: ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 909d4385-025c-4e76-8e31-a60e05b2f73e (dataset): DatasetConfig { id: 909d4385-025c-4e76-8e31-a60e05b2f73e (dataset), name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 929ba34c-583c-48c3-bf57-3530d24a805c (dataset): DatasetConfig { id: 929ba34c-583c-48c3-bf57-3530d24a805c (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 97439057-5f53-4b28-ab5c-09b402b83d64 (dataset): DatasetConfig { id: 97439057-5f53-4b28-ab5c-09b402b83d64 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a16c2e7d-291f-4247-b7d3-ba0b6602489c (dataset): DatasetConfig { id: a16c2e7d-291f-4247-b7d3-ba0b6602489c (dataset), name: DatasetName { pool_name: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a171a293-5e8e-4031-9d44-d0cc9e79862f (dataset): DatasetConfig { id: a171a293-5e8e-4031-9d44-d0cc9e79862f (dataset), name: DatasetName { pool_name: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a29c8cee-9aa4-408c-94fe-f9e24621fc68 (dataset): DatasetConfig { id: a29c8cee-9aa4-408c-94fe-f9e24621fc68 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a511fb0f-89aa-4294-8a6e-472b0ca3c3a9 (dataset): DatasetConfig { id: a511fb0f-89aa-4294-8a6e-472b0ca3c3a9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, aa7ef4cd-08c0-4c8f-9c66-8e844d8cefed (dataset): DatasetConfig { id: aa7ef4cd-08c0-4c8f-9c66-8e844d8cefed (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aec97e0f-af1a-40d1-99ba-6d81f6ef43b8 (dataset): DatasetConfig { id: aec97e0f-af1a-40d1-99ba-6d81f6ef43b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1244efa-ac59-4368-bda1-fdaf7c1a8006 (dataset): DatasetConfig { id: b1244efa-ac59-4368-bda1-fdaf7c1a8006 (dataset), name: DatasetName { pool_name: ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8daa629-881e-4679-b512-f7f72a3550cd (dataset): DatasetConfig { id: b8daa629-881e-4679-b512-f7f72a3550cd (dataset), name: DatasetName { pool_name: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c1766328-d47a-4f98-b248-93883c49fb2a (dataset): DatasetConfig { id: c1766328-d47a-4f98-b248-93883c49fb2a (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c27ec913-dec7-43e4-a73f-5e26f7bd9c7b (dataset): DatasetConfig { id: c27ec913-dec7-43e4-a73f-5e26f7bd9c7b (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ca629cb4-f5fc-4624-a05b-2ce77f50432b (dataset): DatasetConfig { id: ca629cb4-f5fc-4624-a05b-2ce77f50432b (dataset), name: DatasetName { pool_name: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cc8a7f3b-a9ae-40e7-a3e4-57ef4d39c459 (dataset): DatasetConfig { id: cc8a7f3b-a9ae-40e7-a3e4-57ef4d39c459 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce0fc0a1-bddc-4a0b-97ac-78dd3d55de48 (dataset): DatasetConfig { id: ce0fc0a1-bddc-4a0b-97ac-78dd3d55de48 (dataset), name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d3e2eab3-859e-49b7-acd1-f49e829902d5 (dataset): DatasetConfig { id: d3e2eab3-859e-49b7-acd1-f49e829902d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d528637f-0bba-498c-87ab-d9dec5c3bc3d (dataset): DatasetConfig { id: d528637f-0bba-498c-87ab-d9dec5c3bc3d (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dadbcb55-2742-4904-8ff2-fdebc1f65fef (dataset): DatasetConfig { id: dadbcb55-2742-4904-8ff2-fdebc1f65fef (dataset), name: DatasetName { pool_name: ZpoolName { id: a77abd92-fef1-4271-b3d6-7b70ec3d579b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dade2948-6fc3-47a6-99bc-e0b56d678778 (dataset): DatasetConfig { id: dade2948-6fc3-47a6-99bc-e0b56d678778 (dataset), name: DatasetName { pool_name: ZpoolName { id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e399fbfb-7692-4d2f-8953-a625e3edff77 (dataset): DatasetConfig { id: e399fbfb-7692-4d2f-8953-a625e3edff77 (dataset), name: DatasetName { pool_name: ZpoolName { id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e833373e-3fb6-4f41-ae72-06c080f45972 (dataset): DatasetConfig { id: e833373e-3fb6-4f41-ae72-06c080f45972 (dataset), name: DatasetName { pool_name: ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e99bad55-270a-4a31-a9ed-55ba348dc838 (dataset): DatasetConfig { id: e99bad55-270a-4a31-a9ed-55ba348dc838 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb407f9e-78c6-4ca7-b0a3-9b8de054b511 (dataset): DatasetConfig { id: eb407f9e-78c6-4ca7-b0a3-9b8de054b511 (dataset), name: DatasetName { pool_name: ZpoolName { id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ee7140ce-e81c-4d44-a6d7-103fed1881a2 (dataset): DatasetConfig { id: ee7140ce-e81c-4d44-a6d7-103fed1881a2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2605366-df56-4bb2-a1af-82b252b02bd9 (dataset): DatasetConfig { id: f2605366-df56-4bb2-a1af-82b252b02bd9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fffecd8a-d47f-441c-baf7-e245289a93f5 (dataset): DatasetConfig { id: fffecd8a-d47f-441c-baf7-e245289a93f5 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4432025-01-14T22:27:49.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52497
4442025-01-14T22:27:49.623ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:859 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
4452025-01-14T22:27:49.624ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {04eacc05-1a60-4e79-be53-56a033bcf609 (dataset): DatasetConfig { id: 04eacc05-1a60-4e79-be53-56a033bcf609 (dataset), name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 07a81dba-5867-41bc-a525-8dec84b31076 (dataset): DatasetConfig { id: 07a81dba-5867-41bc-a525-8dec84b31076 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0e87bd4c-d6ea-490f-9b32-62be16f18c21 (dataset): DatasetConfig { id: 0e87bd4c-d6ea-490f-9b32-62be16f18c21 (dataset), name: DatasetName { pool_name: ZpoolName { id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0eafa25d-7f60-4d1b-8534-11118bdfffa9 (dataset): DatasetConfig { id: 0eafa25d-7f60-4d1b-8534-11118bdfffa9 (dataset), name: DatasetName { pool_name: ZpoolName { id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 11ee8476-b251-4fd0-a72c-f1ace4a6329a (dataset): DatasetConfig { id: 11ee8476-b251-4fd0-a72c-f1ace4a6329a (dataset), name: DatasetName { pool_name: ZpoolName { id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 183edf54-32e2-45c6-b9ea-dba85f0a74d6 (dataset): DatasetConfig { id: 183edf54-32e2-45c6-b9ea-dba85f0a74d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c2660bc-d76f-481c-8282-b05fd0b25301 (dataset): DatasetConfig { id: 1c2660bc-d76f-481c-8282-b05fd0b25301 (dataset), name: DatasetName { pool_name: ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1fa66e7f-d834-4568-9911-20badf1f391e (dataset): DatasetConfig { id: 1fa66e7f-d834-4568-9911-20badf1f391e (dataset), name: DatasetName { pool_name: ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23144b2a-42e0-464d-b652-b3d9830e6ac9 (dataset): DatasetConfig { id: 23144b2a-42e0-464d-b652-b3d9830e6ac9 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 276ddb2b-37d6-4a86-a798-7840e1f3c9bb (dataset): DatasetConfig { id: 276ddb2b-37d6-4a86-a798-7840e1f3c9bb (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 296c813f-4708-4e6e-841b-f2aa1ee98b56 (dataset): DatasetConfig { id: 296c813f-4708-4e6e-841b-f2aa1ee98b56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 297d1e54-41c5-4d95-a729-592d542cd8eb (dataset): DatasetConfig { id: 297d1e54-41c5-4d95-a729-592d542cd8eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 31bccae8-0f03-4c70-8941-db9ecb728df4 (dataset): DatasetConfig { id: 31bccae8-0f03-4c70-8941-db9ecb728df4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 352cfb99-03ce-40aa-85b7-8480ff1d44a9 (dataset): DatasetConfig { id: 352cfb99-03ce-40aa-85b7-8480ff1d44a9 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3595c016-e15b-4252-b89b-d431f2d9abe0 (dataset): DatasetConfig { id: 3595c016-e15b-4252-b89b-d431f2d9abe0 (dataset), name: DatasetName { pool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a0ee884-b7fe-47d2-add1-f7d5db43cbff (dataset): DatasetConfig { id: 3a0ee884-b7fe-47d2-add1-f7d5db43cbff (dataset), name: DatasetName { pool_name: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3b756d70-8244-424a-bfa1-dc397fe4740a (dataset): DatasetConfig { id: 3b756d70-8244-424a-bfa1-dc397fe4740a (dataset), name: DatasetName { pool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d309ec6-872f-4bc3-8731-7c687f231e52 (dataset): DatasetConfig { id: 3d309ec6-872f-4bc3-8731-7c687f231e52 (dataset), name: DatasetName { pool_name: ZpoolName { id: a77abd92-fef1-4271-b3d6-7b70ec3d579b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4206258a-1540-4b8b-a111-04a11b9efdb0 (dataset): DatasetConfig { id: 4206258a-1540-4b8b-a111-04a11b9efdb0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 430c466a-17aa-4673-9f5e-08915ac4af22 (dataset): DatasetConfig { id: 430c466a-17aa-4673-9f5e-08915ac4af22 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 480e14e5-2fba-4f56-af54-ebc415954c0a (dataset): DatasetConfig { id: 480e14e5-2fba-4f56-af54-ebc415954c0a (dataset), name: DatasetName { pool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 486c4c15-6583-40d9-8192-eb946b97b95a (dataset): DatasetConfig { id: 486c4c15-6583-40d9-8192-eb946b97b95a (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 50134607-3ca3-4dfa-8ecd-ef72a230d1bb (dataset): DatasetConfig { id: 50134607-3ca3-4dfa-8ecd-ef72a230d1bb (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5364a615-b65a-4d0e-8e03-c67edd26a7fd (dataset): DatasetConfig { id: 5364a615-b65a-4d0e-8e03-c67edd26a7fd (dataset), name: DatasetName { pool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5e188fd1-410f-4235-bb17-2ad0baf95a3a (dataset): DatasetConfig { id: 5e188fd1-410f-4235-bb17-2ad0baf95a3a (dataset), name: DatasetName { pool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5ec4057a-5832-4377-9b6c-7110d830b0f5 (dataset): DatasetConfig { id: 5ec4057a-5832-4377-9b6c-7110d830b0f5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6cf96fb6-a9d8-47fe-b787-c8c14f683a33 (dataset): DatasetConfig { id: 6cf96fb6-a9d8-47fe-b787-c8c14f683a33 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 75bf051c-33ee-4451-97b9-6c8d7fd03a01 (dataset): DatasetConfig { id: 75bf051c-33ee-4451-97b9-6c8d7fd03a01 (dataset), name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 76367241-9315-4d40-9738-f1b472870007 (dataset): DatasetConfig { id: 76367241-9315-4d40-9738-f1b472870007 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 771bd8c2-d28b-414f-9fef-913ec985aba6 (dataset): DatasetConfig { id: 771bd8c2-d28b-414f-9fef-913ec985aba6 (dataset), name: DatasetName { pool_name: ZpoolName { id: a77abd92-fef1-4271-b3d6-7b70ec3d579b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7bc531bc-0b1a-4e5f-874f-35454c71316e (dataset): DatasetConfig { id: 7bc531bc-0b1a-4e5f-874f-35454c71316e (dataset), name: DatasetName { pool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7cafcae6-1a7c-425c-9650-e5a5220be343 (dataset): DatasetConfig { id: 7cafcae6-1a7c-425c-9650-e5a5220be343 (dataset), name: DatasetName { pool_name: ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e30b587-dd3c-436f-8f19-4f757cca8b47 (dataset): DatasetConfig { id: 7e30b587-dd3c-436f-8f19-4f757cca8b47 (dataset), name: DatasetName { pool_name: ZpoolName { id: a77abd92-fef1-4271-b3d6-7b70ec3d579b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 850179ce-4388-4d9e-ab9a-74ae8e431b66 (dataset): DatasetConfig { id: 850179ce-4388-4d9e-ab9a-74ae8e431b66 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85449589-808f-40c5-ada0-432eaa7a8bf5 (dataset): DatasetConfig { id: 85449589-808f-40c5-ada0-432eaa7a8bf5 (dataset), name: DatasetName { pool_name: ZpoolName { id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85b09fb6-70d9-4009-a17d-528f5e6fe335 (dataset): DatasetConfig { id: 85b09fb6-70d9-4009-a17d-528f5e6fe335 (dataset), name: DatasetName { pool_name: ZpoolName { id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8872f12a-21f5-46af-880e-df6f5545fc0f (dataset): DatasetConfig { id: 8872f12a-21f5-46af-880e-df6f5545fc0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8d4bf125-f8f8-47bf-b085-e53b5a120bdd (dataset): DatasetConfig { id: 8d4bf125-f8f8-47bf-b085-e53b5a120bdd (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9086164d-9334-4b72-8418-bc13b8b85e5f (dataset): DatasetConfig { id: 9086164d-9334-4b72-8418-bc13b8b85e5f (dataset), name: DatasetName { pool_name: ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 909d4385-025c-4e76-8e31-a60e05b2f73e (dataset): DatasetConfig { id: 909d4385-025c-4e76-8e31-a60e05b2f73e (dataset), name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 929ba34c-583c-48c3-bf57-3530d24a805c (dataset): DatasetConfig { id: 929ba34c-583c-48c3-bf57-3530d24a805c (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 97439057-5f53-4b28-ab5c-09b402b83d64 (dataset): DatasetConfig { id: 97439057-5f53-4b28-ab5c-09b402b83d64 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a16c2e7d-291f-4247-b7d3-ba0b6602489c (dataset): DatasetConfig { id: a16c2e7d-291f-4247-b7d3-ba0b6602489c (dataset), name: DatasetName { pool_name: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a171a293-5e8e-4031-9d44-d0cc9e79862f (dataset): DatasetConfig { id: a171a293-5e8e-4031-9d44-d0cc9e79862f (dataset), name: DatasetName { pool_name: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a29c8cee-9aa4-408c-94fe-f9e24621fc68 (dataset): DatasetConfig { id: a29c8cee-9aa4-408c-94fe-f9e24621fc68 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a511fb0f-89aa-4294-8a6e-472b0ca3c3a9 (dataset): DatasetConfig { id: a511fb0f-89aa-4294-8a6e-472b0ca3c3a9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, aa7ef4cd-08c0-4c8f-9c66-8e844d8cefed (dataset): DatasetConfig { id: aa7ef4cd-08c0-4c8f-9c66-8e844d8cefed (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aec97e0f-af1a-40d1-99ba-6d81f6ef43b8 (dataset): DatasetConfig { id: aec97e0f-af1a-40d1-99ba-6d81f6ef43b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1244efa-ac59-4368-bda1-fdaf7c1a8006 (dataset): DatasetConfig { id: b1244efa-ac59-4368-bda1-fdaf7c1a8006 (dataset), name: DatasetName { pool_name: ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8daa629-881e-4679-b512-f7f72a3550cd (dataset): DatasetConfig { id: b8daa629-881e-4679-b512-f7f72a3550cd (dataset), name: DatasetName { pool_name: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c1766328-d47a-4f98-b248-93883c49fb2a (dataset): DatasetConfig { id: c1766328-d47a-4f98-b248-93883c49fb2a (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c27ec913-dec7-43e4-a73f-5e26f7bd9c7b (dataset): DatasetConfig { id: c27ec913-dec7-43e4-a73f-5e26f7bd9c7b (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ca629cb4-f5fc-4624-a05b-2ce77f50432b (dataset): DatasetConfig { id: ca629cb4-f5fc-4624-a05b-2ce77f50432b (dataset), name: DatasetName { pool_name: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cc8a7f3b-a9ae-40e7-a3e4-57ef4d39c459 (dataset): DatasetConfig { id: cc8a7f3b-a9ae-40e7-a3e4-57ef4d39c459 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce0fc0a1-bddc-4a0b-97ac-78dd3d55de48 (dataset): DatasetConfig { id: ce0fc0a1-bddc-4a0b-97ac-78dd3d55de48 (dataset), name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d3e2eab3-859e-49b7-acd1-f49e829902d5 (dataset): DatasetConfig { id: d3e2eab3-859e-49b7-acd1-f49e829902d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d528637f-0bba-498c-87ab-d9dec5c3bc3d (dataset): DatasetConfig { id: d528637f-0bba-498c-87ab-d9dec5c3bc3d (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dadbcb55-2742-4904-8ff2-fdebc1f65fef (dataset): DatasetConfig { id: dadbcb55-2742-4904-8ff2-fdebc1f65fef (dataset), name: DatasetName { pool_name: ZpoolName { id: a77abd92-fef1-4271-b3d6-7b70ec3d579b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dade2948-6fc3-47a6-99bc-e0b56d678778 (dataset): DatasetConfig { id: dade2948-6fc3-47a6-99bc-e0b56d678778 (dataset), name: DatasetName { pool_name: ZpoolName { id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e399fbfb-7692-4d2f-8953-a625e3edff77 (dataset): DatasetConfig { id: e399fbfb-7692-4d2f-8953-a625e3edff77 (dataset), name: DatasetName { pool_name: ZpoolName { id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e833373e-3fb6-4f41-ae72-06c080f45972 (dataset): DatasetConfig { id: e833373e-3fb6-4f41-ae72-06c080f45972 (dataset), name: DatasetName { pool_name: ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e99bad55-270a-4a31-a9ed-55ba348dc838 (dataset): DatasetConfig { id: e99bad55-270a-4a31-a9ed-55ba348dc838 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb407f9e-78c6-4ca7-b0a3-9b8de054b511 (dataset): DatasetConfig { id: eb407f9e-78c6-4ca7-b0a3-9b8de054b511 (dataset), name: DatasetName { pool_name: ZpoolName { id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ee7140ce-e81c-4d44-a6d7-103fed1881a2 (dataset): DatasetConfig { id: ee7140ce-e81c-4d44-a6d7-103fed1881a2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2605366-df56-4bb2-a1af-82b252b02bd9 (dataset): DatasetConfig { id: f2605366-df56-4bb2-a1af-82b252b02bd9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fffecd8a-d47f-441c-baf7-e245289a93f5 (dataset): DatasetConfig { id: fffecd8a-d47f-441c-baf7-e245289a93f5 (dataset), name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4462025-01-14T22:27:49.624ZINFOSledAgent (StorageManager): No ledger in /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472025-01-14T22:27:49.624ZINFOSledAgent (StorageManager): No ledger in /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4482025-01-14T22:27:49.624ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4492025-01-14T22:27:49.639ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4502025-01-14T22:27:49.639ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4512025-01-14T22:27:49.639ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/193d38c2-fbe5-4b1d-95c5-92a256ddffe2/crypt/zone/oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f"), full_name: "oxp_193d38c2-fbe5-4b1d-95c5-92a256ddffe2/crypt/zone/oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f" } file = sled-storage/src/manager.rs:1431
4522025-01-14T22:27:49.697ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4532025-01-14T22:27:49.697ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4542025-01-14T22:27:49.697ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17026a0f-546c-4e8b-87e1-2bef866e5f38/crypt/debug"), full_name: "oxp_17026a0f-546c-4e8b-87e1-2bef866e5f38/crypt/debug" } file = sled-storage/src/manager.rs:1431
4552025-01-14T22:27:49.725ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4562025-01-14T22:27:49.725ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4572025-01-14T22:27:49.725ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_42c887d6-10d1-4b8b-a7bb-82239cc2998c/crucible" } file = sled-storage/src/manager.rs:1431
4582025-01-14T22:27:49.775ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4592025-01-14T22:27:49.775ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4602025-01-14T22:27:49.775ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59/crypt/zone/oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a"), full_name: "oxp_ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59/crypt/zone/oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a" } file = sled-storage/src/manager.rs:1431
4612025-01-14T22:27:49.832ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4622025-01-14T22:27:49.832ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4632025-01-14T22:27:49.832ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59/crucible" } file = sled-storage/src/manager.rs:1431
4642025-01-14T22:27:49.879ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4652025-01-14T22:27:49.879ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4662025-01-14T22:27:49.879ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/42c887d6-10d1-4b8b-a7bb-82239cc2998c/crypt/zone/oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86"), full_name: "oxp_42c887d6-10d1-4b8b-a7bb-82239cc2998c/crypt/zone/oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86" } file = sled-storage/src/manager.rs:1431
4672025-01-14T22:27:49.937ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4682025-01-14T22:27:49.937ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4692025-01-14T22:27:49.937ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/489724fa-785f-4f35-bb0f-34adf6a09482/crypt/zone/oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3"), full_name: "oxp_489724fa-785f-4f35-bb0f-34adf6a09482/crypt/zone/oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3" } file = sled-storage/src/manager.rs:1431
4702025-01-14T22:27:49.991ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4712025-01-14T22:27:49.991ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4722025-01-14T22:27:49.991ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_489724fa-785f-4f35-bb0f-34adf6a09482/crucible" } file = sled-storage/src/manager.rs:1431
4732025-01-14T22:27:50.039ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4742025-01-14T22:27:50.039ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4752025-01-14T22:27:50.039ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4762025-01-14T22:27:50.088ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4772025-01-14T22:27:50.088ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4782025-01-14T22:27:50.088ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8/crypt/debug"), full_name: "oxp_dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8/crypt/debug" } file = sled-storage/src/manager.rs:1431
4792025-01-14T22:27:50.117ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4802025-01-14T22:27:50.117ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4812025-01-14T22:27:50.117ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/193d38c2-fbe5-4b1d-95c5-92a256ddffe2/crypt/zone/oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19"), full_name: "oxp_193d38c2-fbe5-4b1d-95c5-92a256ddffe2/crypt/zone/oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19" } file = sled-storage/src/manager.rs:1431
4822025-01-14T22:27:50.174ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4832025-01-14T22:27:50.174ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4842025-01-14T22:27:50.174ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/42c887d6-10d1-4b8b-a7bb-82239cc2998c/crypt/debug"), full_name: "oxp_42c887d6-10d1-4b8b-a7bb-82239cc2998c/crypt/debug" } file = sled-storage/src/manager.rs:1431
4852025-01-14T22:27:50.199ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/652f7dd4-af0c-42f1-b515-fb2bf74375f9) file = sled-agent/src/probe_manager.rs:231 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
4862025-01-14T22:27:50.203ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4872025-01-14T22:27:50.203ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4882025-01-14T22:27:50.203ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f72d9943-3b41-40fd-968b-8debb9d0e66b/crypt/zone/oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764"), full_name: "oxp_f72d9943-3b41-40fd-968b-8debb9d0e66b/crypt/zone/oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764" } file = sled-storage/src/manager.rs:1431
4892025-01-14T22:27:50.262ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4902025-01-14T22:27:50.262ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4912025-01-14T22:27:50.262ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8/crypt/zone/oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4"), full_name: "oxp_dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8/crypt/zone/oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4" } file = sled-storage/src/manager.rs:1431
4922025-01-14T22:27:50.322ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4932025-01-14T22:27:50.322ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4942025-01-14T22:27:50.322ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f72d9943-3b41-40fd-968b-8debb9d0e66b/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4952025-01-14T22:27:50.369ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4962025-01-14T22:27:50.369ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4972025-01-14T22:27:50.369ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ebeecaa7-8727-491c-81b6-8ff8177ba2c6/crypt/zone"), full_name: "oxp_ebeecaa7-8727-491c-81b6-8ff8177ba2c6/crypt/zone" } file = sled-storage/src/manager.rs:1431
4982025-01-14T22:27:50.399ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4992025-01-14T22:27:50.399ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5002025-01-14T22:27:50.399ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f72d9943-3b41-40fd-968b-8debb9d0e66b/crypt/zone/oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3"), full_name: "oxp_f72d9943-3b41-40fd-968b-8debb9d0e66b/crypt/zone/oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3" } file = sled-storage/src/manager.rs:1431
5012025-01-14T22:27:50.459ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5022025-01-14T22:27:50.459ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5032025-01-14T22:27:50.459ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a77abd92-fef1-4271-b3d6-7b70ec3d579b/crucible" } file = sled-storage/src/manager.rs:1431
5042025-01-14T22:27:50.507ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5052025-01-14T22:27:50.507ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5062025-01-14T22:27:50.507ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_17026a0f-546c-4e8b-87e1-2bef866e5f38/crucible" } file = sled-storage/src/manager.rs:1431
5072025-01-14T22:27:50.553ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5082025-01-14T22:27:50.553ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5092025-01-14T22:27:50.553ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17026a0f-546c-4e8b-87e1-2bef866e5f38/crypt/zone/oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda"), full_name: "oxp_17026a0f-546c-4e8b-87e1-2bef866e5f38/crypt/zone/oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda" } file = sled-storage/src/manager.rs:1431
5102025-01-14T22:27:50.612ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5112025-01-14T22:27:50.612ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5122025-01-14T22:27:50.612ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f72d9943-3b41-40fd-968b-8debb9d0e66b/crucible" } file = sled-storage/src/manager.rs:1431
5132025-01-14T22:27:50.660ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5142025-01-14T22:27:50.660ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5152025-01-14T22:27:50.660ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_17026a0f-546c-4e8b-87e1-2bef866e5f38/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5162025-01-14T22:27:50.709ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5172025-01-14T22:27:50.709ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5182025-01-14T22:27:50.709ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17026a0f-546c-4e8b-87e1-2bef866e5f38/crypt/zone/oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef"), full_name: "oxp_17026a0f-546c-4e8b-87e1-2bef866e5f38/crypt/zone/oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef" } file = sled-storage/src/manager.rs:1431
5192025-01-14T22:27:50.770ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5202025-01-14T22:27:50.770ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5212025-01-14T22:27:50.770ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f72d9943-3b41-40fd-968b-8debb9d0e66b/crypt/zone/oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4"), full_name: "oxp_f72d9943-3b41-40fd-968b-8debb9d0e66b/crypt/zone/oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4" } file = sled-storage/src/manager.rs:1431
5222025-01-14T22:27:50.829ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5232025-01-14T22:27:50.829ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5242025-01-14T22:27:50.829ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f72d9943-3b41-40fd-968b-8debb9d0e66b/crypt/zone"), full_name: "oxp_f72d9943-3b41-40fd-968b-8debb9d0e66b/crypt/zone" } file = sled-storage/src/manager.rs:1431
5252025-01-14T22:27:50.858ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5262025-01-14T22:27:50.858ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5272025-01-14T22:27:50.858ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_193d38c2-fbe5-4b1d-95c5-92a256ddffe2/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5282025-01-14T22:27:50.907ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5292025-01-14T22:27:50.907ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5302025-01-14T22:27:50.907ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8/crypt/zone/oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4"), full_name: "oxp_dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8/crypt/zone/oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4" } file = sled-storage/src/manager.rs:1431
5312025-01-14T22:27:50.967ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5322025-01-14T22:27:50.967ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5332025-01-14T22:27:50.967ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_193d38c2-fbe5-4b1d-95c5-92a256ddffe2/crucible" } file = sled-storage/src/manager.rs:1431
5342025-01-14T22:27:51.016ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5352025-01-14T22:27:51.016ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5362025-01-14T22:27:51.016ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5372025-01-14T22:27:51.064ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5382025-01-14T22:27:51.064ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5392025-01-14T22:27:51.064ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a77abd92-fef1-4271-b3d6-7b70ec3d579b/crypt/debug"), full_name: "oxp_a77abd92-fef1-4271-b3d6-7b70ec3d579b/crypt/debug" } file = sled-storage/src/manager.rs:1431
5402025-01-14T22:27:51.092ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5412025-01-14T22:27:51.093ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5422025-01-14T22:27:51.093ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f72d9943-3b41-40fd-968b-8debb9d0e66b/crypt/debug"), full_name: "oxp_f72d9943-3b41-40fd-968b-8debb9d0e66b/crypt/debug" } file = sled-storage/src/manager.rs:1431
5432025-01-14T22:27:51.121ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5442025-01-14T22:27:51.121ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5452025-01-14T22:27:51.121ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/489724fa-785f-4f35-bb0f-34adf6a09482/crypt/zone/oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6"), full_name: "oxp_489724fa-785f-4f35-bb0f-34adf6a09482/crypt/zone/oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6" } file = sled-storage/src/manager.rs:1431
5462025-01-14T22:27:51.180ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5472025-01-14T22:27:51.180ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5482025-01-14T22:27:51.180ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a77abd92-fef1-4271-b3d6-7b70ec3d579b/crypt/zone/oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d"), full_name: "oxp_a77abd92-fef1-4271-b3d6-7b70ec3d579b/crypt/zone/oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d" } file = sled-storage/src/manager.rs:1431
5492025-01-14T22:27:51.201ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/652f7dd4-af0c-42f1-b515-fb2bf74375f9) file = sled-agent/src/probe_manager.rs:231 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
5502025-01-14T22:27:51.241ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5512025-01-14T22:27:51.241ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5522025-01-14T22:27:51.241ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17026a0f-546c-4e8b-87e1-2bef866e5f38/crypt/zone/oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042"), full_name: "oxp_17026a0f-546c-4e8b-87e1-2bef866e5f38/crypt/zone/oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042" } file = sled-storage/src/manager.rs:1431
5532025-01-14T22:27:51.300ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5542025-01-14T22:27:51.300ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5552025-01-14T22:27:51.300ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59/crypt/zone/oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047"), full_name: "oxp_ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59/crypt/zone/oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047" } file = sled-storage/src/manager.rs:1431
5562025-01-14T22:27:51.359ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5572025-01-14T22:27:51.359ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5582025-01-14T22:27:51.359ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/42c887d6-10d1-4b8b-a7bb-82239cc2998c/crypt/zone"), full_name: "oxp_42c887d6-10d1-4b8b-a7bb-82239cc2998c/crypt/zone" } file = sled-storage/src/manager.rs:1431
5592025-01-14T22:27:51.388ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5602025-01-14T22:27:51.388ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5612025-01-14T22:27:51.388ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17026a0f-546c-4e8b-87e1-2bef866e5f38/crypt/zone"), full_name: "oxp_17026a0f-546c-4e8b-87e1-2bef866e5f38/crypt/zone" } file = sled-storage/src/manager.rs:1431
5622025-01-14T22:27:51.418ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5632025-01-14T22:27:51.418ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5642025-01-14T22:27:51.418ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8/crucible" } file = sled-storage/src/manager.rs:1431
5652025-01-14T22:27:51.467ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5662025-01-14T22:27:51.467ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5672025-01-14T22:27:51.467ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/489724fa-785f-4f35-bb0f-34adf6a09482/crypt/debug"), full_name: "oxp_489724fa-785f-4f35-bb0f-34adf6a09482/crypt/debug" } file = sled-storage/src/manager.rs:1431
5682025-01-14T22:27:51.497ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5692025-01-14T22:27:51.497ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5702025-01-14T22:27:51.497ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/193d38c2-fbe5-4b1d-95c5-92a256ddffe2/crypt/zone/oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f"), full_name: "oxp_193d38c2-fbe5-4b1d-95c5-92a256ddffe2/crypt/zone/oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f" } file = sled-storage/src/manager.rs:1431
5712025-01-14T22:27:51.557ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5722025-01-14T22:27:51.557ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5732025-01-14T22:27:51.557ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5742025-01-14T22:27:51.605ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5752025-01-14T22:27:51.605ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5762025-01-14T22:27:51.605ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8/crypt/zone/oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d"), full_name: "oxp_dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8/crypt/zone/oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d" } file = sled-storage/src/manager.rs:1431
5772025-01-14T22:27:51.664ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5782025-01-14T22:27:51.664ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5792025-01-14T22:27:51.664ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ebeecaa7-8727-491c-81b6-8ff8177ba2c6/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5802025-01-14T22:27:51.713ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5812025-01-14T22:27:51.713ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5822025-01-14T22:27:51.713ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ebeecaa7-8727-491c-81b6-8ff8177ba2c6/crypt/zone/oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e"), full_name: "oxp_ebeecaa7-8727-491c-81b6-8ff8177ba2c6/crypt/zone/oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e" } file = sled-storage/src/manager.rs:1431
5832025-01-14T22:27:51.774ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5842025-01-14T22:27:51.774ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5852025-01-14T22:27:51.774ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ebeecaa7-8727-491c-81b6-8ff8177ba2c6/crypt/zone/oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12"), full_name: "oxp_ebeecaa7-8727-491c-81b6-8ff8177ba2c6/crypt/zone/oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12" } file = sled-storage/src/manager.rs:1431
5862025-01-14T22:27:51.833ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5872025-01-14T22:27:51.833ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5882025-01-14T22:27:51.833ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/193d38c2-fbe5-4b1d-95c5-92a256ddffe2/crypt/debug"), full_name: "oxp_193d38c2-fbe5-4b1d-95c5-92a256ddffe2/crypt/debug" } file = sled-storage/src/manager.rs:1431
5892025-01-14T22:27:51.862ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5902025-01-14T22:27:51.862ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5912025-01-14T22:27:51.862ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
5922025-01-14T22:27:51.910ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5932025-01-14T22:27:51.910ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5942025-01-14T22:27:51.910ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/193d38c2-fbe5-4b1d-95c5-92a256ddffe2/crypt/zone"), full_name: "oxp_193d38c2-fbe5-4b1d-95c5-92a256ddffe2/crypt/zone" } file = sled-storage/src/manager.rs:1431
5952025-01-14T22:27:51.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5962025-01-14T22:27:51.941ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5972025-01-14T22:27:51.941ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/489724fa-785f-4f35-bb0f-34adf6a09482/crypt/zone/oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03"), full_name: "oxp_489724fa-785f-4f35-bb0f-34adf6a09482/crypt/zone/oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03" } file = sled-storage/src/manager.rs:1431
5982025-01-14T22:27:52.000ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5992025-01-14T22:27:52.000ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6002025-01-14T22:27:52.000ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ebeecaa7-8727-491c-81b6-8ff8177ba2c6/crucible" } file = sled-storage/src/manager.rs:1431
6012025-01-14T22:27:52.051ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6022025-01-14T22:27:52.051ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6032025-01-14T22:27:52.051ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17026a0f-546c-4e8b-87e1-2bef866e5f38/crypt/zone/oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6"), full_name: "oxp_17026a0f-546c-4e8b-87e1-2bef866e5f38/crypt/zone/oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6" } file = sled-storage/src/manager.rs:1431
6042025-01-14T22:27:52.112ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6052025-01-14T22:27:52.112ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6062025-01-14T22:27:52.112ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17026a0f-546c-4e8b-87e1-2bef866e5f38/crypt/zone/oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675"), full_name: "oxp_17026a0f-546c-4e8b-87e1-2bef866e5f38/crypt/zone/oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675" } file = sled-storage/src/manager.rs:1431
6072025-01-14T22:27:52.174ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6082025-01-14T22:27:52.174ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6092025-01-14T22:27:52.174ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ebeecaa7-8727-491c-81b6-8ff8177ba2c6/crypt/debug"), full_name: "oxp_ebeecaa7-8727-491c-81b6-8ff8177ba2c6/crypt/debug" } file = sled-storage/src/manager.rs:1431
6102025-01-14T22:27:52.202ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/652f7dd4-af0c-42f1-b515-fb2bf74375f9) file = sled-agent/src/probe_manager.rs:231 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
6112025-01-14T22:27:52.203ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6122025-01-14T22:27:52.203ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6132025-01-14T22:27:52.203ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17026a0f-546c-4e8b-87e1-2bef866e5f38/crypt/zone/oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c"), full_name: "oxp_17026a0f-546c-4e8b-87e1-2bef866e5f38/crypt/zone/oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c" } file = sled-storage/src/manager.rs:1431
6142025-01-14T22:27:52.263ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6152025-01-14T22:27:52.263ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6162025-01-14T22:27:52.263ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_193d38c2-fbe5-4b1d-95c5-92a256ddffe2/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6172025-01-14T22:27:52.313ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6182025-01-14T22:27:52.313ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6192025-01-14T22:27:52.313ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8/crypt/zone/oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9"), full_name: "oxp_dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8/crypt/zone/oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9" } file = sled-storage/src/manager.rs:1431
6202025-01-14T22:27:52.375ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6212025-01-14T22:27:52.375ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6222025-01-14T22:27:52.375ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17026a0f-546c-4e8b-87e1-2bef866e5f38/crypt/zone/oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117"), full_name: "oxp_17026a0f-546c-4e8b-87e1-2bef866e5f38/crypt/zone/oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117" } file = sled-storage/src/manager.rs:1431
6232025-01-14T22:27:52.435ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6242025-01-14T22:27:52.435ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6252025-01-14T22:27:52.435ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a77abd92-fef1-4271-b3d6-7b70ec3d579b/crypt/zone"), full_name: "oxp_a77abd92-fef1-4271-b3d6-7b70ec3d579b/crypt/zone" } file = sled-storage/src/manager.rs:1431
6262025-01-14T22:27:52.463ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6272025-01-14T22:27:52.463ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6282025-01-14T22:27:52.463ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/42c887d6-10d1-4b8b-a7bb-82239cc2998c/crypt/zone/oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d"), full_name: "oxp_42c887d6-10d1-4b8b-a7bb-82239cc2998c/crypt/zone/oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d" } file = sled-storage/src/manager.rs:1431
6292025-01-14T22:27:52.524ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6302025-01-14T22:27:52.524ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6312025-01-14T22:27:52.524ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59/crypt/zone"), full_name: "oxp_ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59/crypt/zone" } file = sled-storage/src/manager.rs:1431
6322025-01-14T22:27:52.553ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6332025-01-14T22:27:52.553ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6342025-01-14T22:27:52.553ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/489724fa-785f-4f35-bb0f-34adf6a09482/crypt/zone"), full_name: "oxp_489724fa-785f-4f35-bb0f-34adf6a09482/crypt/zone" } file = sled-storage/src/manager.rs:1431
6352025-01-14T22:27:52.581ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6362025-01-14T22:27:52.581ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6372025-01-14T22:27:52.581ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8/crypt/zone/oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a"), full_name: "oxp_dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8/crypt/zone/oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a" } file = sled-storage/src/manager.rs:1431
6382025-01-14T22:27:52.642ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6392025-01-14T22:27:52.642ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6402025-01-14T22:27:52.642ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59/crypt/debug"), full_name: "oxp_ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59/crypt/debug" } file = sled-storage/src/manager.rs:1431
6412025-01-14T22:27:52.671ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6422025-01-14T22:27:52.671ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6432025-01-14T22:27:52.671ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_17026a0f-546c-4e8b-87e1-2bef866e5f38/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6442025-01-14T22:27:52.720ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6452025-01-14T22:27:52.720ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6462025-01-14T22:27:52.720ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_17026a0f-546c-4e8b-87e1-2bef866e5f38/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6472025-01-14T22:27:52.773ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6482025-01-14T22:27:52.773ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6492025-01-14T22:27:52.773ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8/crypt/zone"), full_name: "oxp_dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8/crypt/zone" } file = sled-storage/src/manager.rs:1431
6502025-01-14T22:27:52.805ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6512025-01-14T22:27:52.806ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6522025-01-14T22:27:52.806ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:861 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
6532025-01-14T22:27:52.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3182803 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:52497 req_id = 4d07e88e-d1dc-40d7-9386-9711456568df response_code = 200 uri = /datasets
6542025-01-14T22:27:52.839ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: bbf0c713-a573-41b3-9c51-a4965b8639a4 (service), filesystem_pool: Some(ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 9d4edcc9-3f8e-4f2d-a69b-18370f25b36c (service), filesystem_pool: Some(ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 9aa50efb-886c-4ee7-9ecb-a39c950f475f (service), filesystem_pool: Some(ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6552025-01-14T22:27:52.839ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36402
6562025-01-14T22:27:52.839ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6572025-01-14T22:27:52.840ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6582025-01-14T22:27:52.849ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6592025-01-14T22:27:52.849ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6602025-01-14T22:27:52.859ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6612025-01-14T22:27:52.859ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6622025-01-14T22:27:52.868ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6632025-01-14T22:27:52.868ZINFOSledAgent (ServiceManager): No ledger in /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/omicron-zones.json file = common/src/ledger.rs:188
6642025-01-14T22:27:52.868ZINFOSledAgent (ServiceManager): No ledger in /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/omicron-zones.json file = common/src/ledger.rs:188
6652025-01-14T22:27:52.868ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6662025-01-14T22:27:52.912ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6672025-01-14T22:27:52.912ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682025-01-14T22:27:52.913ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692025-01-14T22:27:52.965ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f file = illumos-utils/src/zone.rs:325
6702025-01-14T22:27:52.969ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4 file = illumos-utils/src/zone.rs:325
6712025-01-14T22:27:52.973ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c file = illumos-utils/src/zone.rs:325
6722025-01-14T22:27:52.986ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f file = illumos-utils/src/zone.rs:363
6732025-01-14T22:27:52.990ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4 file = illumos-utils/src/zone.rs:363
6742025-01-14T22:27:52.995ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c file = illumos-utils/src/zone.rs:363
6752025-01-14T22:27:53.205ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/652f7dd4-af0c-42f1-b515-fb2bf74375f9) file = sled-agent/src/probe_manager.rs:231 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
6762025-01-14T22:27:54.114ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 13.268848771s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
6772025-01-14T22:27:54.607ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6782025-01-14T22:27:54.607ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6792025-01-14T22:27:54.607ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c
6802025-01-14T22:27:54.858ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1355851588213291876 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
6812025-01-14T22:27:54.858ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16242841666557994989 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
6822025-01-14T22:27:54.886ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4467
6832025-01-14T22:27:54.886ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4494
6842025-01-14T22:27:54.972ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4507
6852025-01-14T22:27:54.972ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4353
6862025-01-14T22:27:55.059ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4395
6872025-01-14T22:27:55.059ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4474 rack_subnet = fd00:1122:3344::
6882025-01-14T22:27:55.081ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4485
6892025-01-14T22:27:55.081ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4527
6902025-01-14T22:27:55.094ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6912025-01-14T22:27:55.165ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4559
6922025-01-14T22:27:55.165ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4565
6932025-01-14T22:27:55.260ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4606
6942025-01-14T22:27:55.260ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6952025-01-14T22:27:55.294ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 35.056671ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
6962025-01-14T22:27:55.331ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 82.784267ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
6972025-01-14T22:27:55.415ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
6982025-01-14T22:27:55.447ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
6992025-01-14T22:27:55.448ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7002025-01-14T22:27:55.448ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 0
7012025-01-14T22:27:55.448ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7022025-01-14T22:27:55.486ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
7032025-01-14T22:27:55.534ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7042025-01-14T22:27:55.535ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7052025-01-14T22:27:55.535ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7062025-01-14T22:27:55.535ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7072025-01-14T22:27:55.535ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7082025-01-14T22:27:55.535ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7092025-01-14T22:27:55.535ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7102025-01-14T22:27:55.535ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7112025-01-14T22:27:55.535ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7122025-01-14T22:27:55.535ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7132025-01-14T22:27:55.535ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7142025-01-14T22:27:55.535ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7152025-01-14T22:27:55.535ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7162025-01-14T22:27:55.535ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7172025-01-14T22:27:55.535ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7182025-01-14T22:27:55.535ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7192025-01-14T22:27:55.535ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7202025-01-14T22:27:55.535ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7212025-01-14T22:27:55.535ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7222025-01-14T22:27:55.535ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7232025-01-14T22:27:55.535ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7242025-01-14T22:27:55.535ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7252025-01-14T22:27:55.535ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7262025-01-14T22:27:55.577ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7272025-01-14T22:27:55.577ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
7282025-01-14T22:27:55.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c") failed: Property not found. retry in 51.396878ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c
7292025-01-14T22:27:55.585ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
7302025-01-14T22:27:55.585ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f
7312025-01-14T22:27:55.590ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4
7322025-01-14T22:27:55.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c") failed: Property not found. retry in 63.058516ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c
7332025-01-14T22:27:55.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f") failed: Property not found. retry in 29.544499ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f
7342025-01-14T22:27:55.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c") failed: Property not found. retry in 106.519534ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c
7352025-01-14T22:27:55.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4") failed: Property not found. retry in 67.945065ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4
7362025-01-14T22:27:55.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f") failed: Property not found. retry in 65.998853ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f
7372025-01-14T22:27:55.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4") failed: Property not found. retry in 79.32973ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4
7382025-01-14T22:27:55.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f") failed: Property not found. retry in 258.564711ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f
7392025-01-14T22:27:55.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c") failed: Property not found. retry in 231.87719ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c
7402025-01-14T22:27:56.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4") failed: Property not found. retry in 213.015852ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4
7412025-01-14T22:27:56.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c") failed: Property not found. retry in 1.183459526s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c
7422025-01-14T22:27:56.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f") failed: Property not found. retry in 431.97644ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f
7432025-01-14T22:27:56.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4") failed: Property not found. retry in 315.197105ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4
7442025-01-14T22:27:56.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4") failed: Property not found. retry in 711.811638ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4
7452025-01-14T22:27:56.568ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1371723932291147185 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
7462025-01-14T22:27:56.568ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6903098002638956888 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
7472025-01-14T22:27:56.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f") failed: Property not found. retry in 540.311677ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f
7482025-01-14T22:27:57.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f") failed: Property not found. retry in 606.927868ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f
7492025-01-14T22:27:57.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4") failed: Property not found. retry in 1.285705046s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4
7502025-01-14T22:27:57.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c") failed: Property not found. retry in 1.437900049s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c
7512025-01-14T22:27:57.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f") failed: Property not found. retry in 518.146771ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f
7522025-01-14T22:27:58.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f") failed: Property not found. retry in 557.082782ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f
7532025-01-14T22:27:58.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4") failed: Property not found. retry in 806.709836ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4
7542025-01-14T22:27:58.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c") failed: Property not found. retry in 541.942014ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c
7552025-01-14T22:27:58.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f") failed: Property not found. retry in 1.35886275s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f
7562025-01-14T22:27:59.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c") failed: Property not found. retry in 1.191205993s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c
7572025-01-14T22:27:59.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4") failed: Property not found. retry in 871.510312ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4
7582025-01-14T22:28:00.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4") failed: Property not found. retry in 1.397521104s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4
7592025-01-14T22:28:00.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f") failed: Property not found. retry in 775.516263ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f
7602025-01-14T22:28:01.708ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_9aa50efb-886c-4ee7-9ecb-a39c950f475f
7612025-01-14T22:28:01.708ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_bbf0c713-a573-41b3-9c51-a4965b8639a4
7622025-01-14T22:28:01.708ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_9d4edcc9-3f8e-4f2d-a69b-18370f25b36c
7632025-01-14T22:28:01.708ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7642025-01-14T22:28:01.708ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7652025-01-14T22:28:01.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8869125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36402 req_id = b894f4aa-0448-41a8-b3be-20929d863182 response_code = 204 uri = /omicron-zones
7662025-01-14T22:28:01.710ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7672025-01-14T22:28:01.762ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 63.936545ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7682025-01-14T22:28:01.827ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 172.694719ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7692025-01-14T22:28:02.063ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7702025-01-14T22:28:02.188ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7712025-01-14T22:28:02.285ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7722025-01-14T22:28:02.285ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7732025-01-14T22:28:02.318ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7742025-01-14T22:28:02.319ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7752025-01-14T22:28:02.319ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7762025-01-14T22:28:02.348ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: bbf0c713-a573-41b3-9c51-a4965b8639a4 (service), filesystem_pool: Some(ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 9d4edcc9-3f8e-4f2d-a69b-18370f25b36c (service), filesystem_pool: Some(ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 9aa50efb-886c-4ee7-9ecb-a39c950f475f (service), filesystem_pool: Some(ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ea402e43-449c-4c8d-9d02-3cca94752675 (service), filesystem_pool: Some(ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 66a5c7c4-05d9-4080-b475-882de1550444, kind: Service { id: ea402e43-449c-4c8d-9d02-3cca94752675 }, name: Name("ntp-ea402e43-449c-4c8d-9d02-3cca94752675"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 189])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7772025-01-14T22:28:02.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62499
7782025-01-14T22:28:02.349ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7792025-01-14T22:28:02.349ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7802025-01-14T22:28:02.360ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7812025-01-14T22:28:02.360ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7822025-01-14T22:28:02.370ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7832025-01-14T22:28:02.370ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7842025-01-14T22:28:02.380ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7852025-01-14T22:28:02.380ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/omicron-zones.json file = common/src/ledger.rs:177
7862025-01-14T22:28:02.380ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/omicron-zones.json file = common/src/ledger.rs:177
7872025-01-14T22:28:02.380ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7882025-01-14T22:28:02.391ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7892025-01-14T22:28:02.424ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7902025-01-14T22:28:02.424ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7912025-01-14T22:28:02.424ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7922025-01-14T22:28:02.454ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 161, 189]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7932025-01-14T22:28:02.455ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = boundary_ntp
7942025-01-14T22:28:02.455ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7952025-01-14T22:28:02.455ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7962025-01-14T22:28:02.455ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7972025-01-14T22:28:02.457ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7982025-01-14T22:28:02.483ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675 file = illumos-utils/src/zone.rs:325
7992025-01-14T22:28:02.502ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675 file = illumos-utils/src/zone.rs:363
8002025-01-14T22:28:03.116ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8012025-01-14T22:28:03.116ZINFOSledAgent (ServiceManager): Booting oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675
8022025-01-14T22:28:03.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675") failed: Property not found. retry in 59.657168ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675
8032025-01-14T22:28:03.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675") failed: Property not found. retry in 127.780829ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675
8042025-01-14T22:28:03.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675") failed: Property not found. retry in 119.136835ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675
8052025-01-14T22:28:03.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675") failed: Property not found. retry in 222.585881ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675
8062025-01-14T22:28:03.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675") failed: Property not found. retry in 610.758837ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675
8072025-01-14T22:28:04.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675") failed: Property not found. retry in 1.026664879s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675
8082025-01-14T22:28:04.859ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1355851588213291876 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
8092025-01-14T22:28:04.859ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16242841666557994989 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
8102025-01-14T22:28:05.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675") failed: Property not found. retry in 1.278349083s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675
8112025-01-14T22:28:06.570ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1371723932291147185 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
8122025-01-14T22:28:06.570ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6903098002638956888 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
8132025-01-14T22:28:06.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675") failed: Property not found. retry in 1.447311842s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675
8142025-01-14T22:28:08.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675") failed: Property not found. retry in 910.478256ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675
8152025-01-14T22:28:09.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675") failed: Property not found. retry in 835.297144ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675
8162025-01-14T22:28:09.998ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675
8172025-01-14T22:28:09.998ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8182025-01-14T22:28:09.998ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8192025-01-14T22:28:09.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7649971 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:62499 req_id = 3fda8e4f-9c5c-4f03-9d19-c82b47e13b8c response_code = 204 uri = /omicron-zones
8202025-01-14T22:28:10.001ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8212025-01-14T22:28:10.032ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8222025-01-14T22:28:10.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59004
8232025-01-14T22:28:10.041ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8242025-01-14T22:28:10.041ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9559 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59004 req_id = d9c63327-ff24-4d72-ba29-506ebc191aad response_code = 500 uri = /timesync
8252025-01-14T22:28:10.044ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8262025-01-14T22:28:10.164ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8272025-01-14T22:28:10.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47397
8282025-01-14T22:28:10.619ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 720958829326993617 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
8292025-01-14T22:28:11.099ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15843714721872555246 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
8302025-01-14T22:28:11.712ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18053398597699293300 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
8312025-01-14T22:28:14.173ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8322025-01-14T22:28:14.173ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008935 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47397 req_id = 44c84b31-88dd-4f99-ac33-2dd549f4f24d response_code = 500 uri = /timesync
8332025-01-14T22:28:14.175ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8342025-01-14T22:28:14.324ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8352025-01-14T22:28:14.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37627
8362025-01-14T22:28:14.333ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8372025-01-14T22:28:14.333ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8711 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37627 req_id = 5aacaa9a-36df-4b23-84df-3d54fc494f2b response_code = 500 uri = /timesync
8382025-01-14T22:28:14.335ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8392025-01-14T22:28:14.479ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8402025-01-14T22:28:14.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53812
8412025-01-14T22:28:14.861ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1355851588213291876 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
8422025-01-14T22:28:14.861ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16242841666557994989 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
8432025-01-14T22:28:16.571ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1371723932291147185 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
8442025-01-14T22:28:16.571ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6903098002638956888 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
8452025-01-14T22:28:18.392ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ea402e43-449c-4c8d-9d02-3cca94752675': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8462025-01-14T22:28:18.393ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008086 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53812 req_id = 40d9bd62-714f-423e-8278-29d2a636138e response_code = 500 uri = /timesync
8472025-01-14T22:28:18.395ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8482025-01-14T22:28:18.553ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8492025-01-14T22:28:18.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36460
8502025-01-14T22:28:18.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8956 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36460 req_id = b47b5c84-4f1b-4c46-bd16-c646ea4192f0 response_code = 200 uri = /timesync
8512025-01-14T22:28:18.563ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1736893697.7395625, correction: -0.366994143 } file = sled-agent/src/rack_setup/service.rs:743
8522025-01-14T22:28:18.563ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8532025-01-14T22:28:18.796ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8542025-01-14T22:28:18.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47470
8552025-01-14T22:28:18.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8287 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47470 req_id = 58c917f6-b049-409c-b88b-6df5e4b1c6df response_code = 200 uri = /timesync
8562025-01-14T22:28:18.807ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1736893697.7395625, correction: -0.366334826 } file = sled-agent/src/rack_setup/service.rs:743
8572025-01-14T22:28:18.807ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8582025-01-14T22:28:19.140ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8592025-01-14T22:28:19.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38016
8602025-01-14T22:28:19.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8046 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38016 req_id = da41fb46-3fff-4b9b-8075-844c22ba6c55 response_code = 200 uri = /timesync
8612025-01-14T22:28:19.151ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3422717603, ip_addr: 204.2.134.163, stratum: 4, ref_time: 1736893698.1652937, correction: -0.363509536 } file = sled-agent/src/rack_setup/service.rs:743
8622025-01-14T22:28:19.151ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8632025-01-14T22:28:19.377ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8642025-01-14T22:28:19.377ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39351
8652025-01-14T22:28:19.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39351 req_id = 1e213ebc-7ce5-4ba0-9c4e-0e1298e88c15 response_code = 200 uri = /timesync
8662025-01-14T22:28:19.387ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3422717603, ip_addr: 204.2.134.163, stratum: 4, ref_time: 1736893698.1652937, correction: -0.362865865 } file = sled-agent/src/rack_setup/service.rs:743
8672025-01-14T22:28:19.387ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8682025-01-14T22:28:19.636ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8692025-01-14T22:28:19.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42980
8702025-01-14T22:28:19.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7756 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42980 req_id = b7588171-7fdd-4c0b-abab-bef964c6498d response_code = 200 uri = /timesync
8712025-01-14T22:28:19.646ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893698.8164082, correction: -0.352776438 } file = sled-agent/src/rack_setup/service.rs:743
8722025-01-14T22:28:19.646ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8732025-01-14T22:28:19.905ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11154361167794969718 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
8742025-01-14T22:28:19.905ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17311797621590698199 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
8752025-01-14T22:28:19.986ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8762025-01-14T22:28:19.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53613
8772025-01-14T22:28:19.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7989 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53613 req_id = 8437e65b-c2ff-4d81-951b-b21f7312c43d response_code = 200 uri = /timesync
8782025-01-14T22:28:19.996ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893698.8164082, correction: -0.35182488 } file = sled-agent/src/rack_setup/service.rs:743
8792025-01-14T22:28:19.996ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8802025-01-14T22:28:20.471ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8812025-01-14T22:28:20.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34179
8822025-01-14T22:28:20.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8602 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34179 req_id = 4da1228f-c407-4389-80f5-dc81e84d00d9 response_code = 200 uri = /timesync
8832025-01-14T22:28:20.481ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893699.064776, correction: -0.351224422 } file = sled-agent/src/rack_setup/service.rs:743
8842025-01-14T22:28:20.481ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8852025-01-14T22:28:20.523ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 720958829326993617 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
8862025-01-14T22:28:20.999ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15843714721872555246 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
8872025-01-14T22:28:21.143ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8882025-01-14T22:28:21.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55660
8892025-01-14T22:28:21.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8510 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55660 req_id = 65260191-ab4e-449d-979d-b496e4ecf64b response_code = 200 uri = /timesync
8902025-01-14T22:28:21.153ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893699.064776, correction: -0.349400282 } file = sled-agent/src/rack_setup/service.rs:743
8912025-01-14T22:28:21.153ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8922025-01-14T22:28:21.613ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18053398597699293300 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
8932025-01-14T22:28:22.170ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8942025-01-14T22:28:22.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63815
8952025-01-14T22:28:22.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7710 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63815 req_id = 438efd52-4632-48f9-b211-1bc41da2dd30 response_code = 200 uri = /timesync
8962025-01-14T22:28:22.179ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893700.671444, correction: -0.353346974 } file = sled-agent/src/rack_setup/service.rs:743
8972025-01-14T22:28:22.179ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8982025-01-14T22:28:22.316ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 239.588818ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
8992025-01-14T22:28:23.366ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9002025-01-14T22:28:23.366ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39708
9012025-01-14T22:28:23.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39708 req_id = e9898f20-9aca-462f-8dfa-4d9b4f516595 response_code = 200 uri = /timesync
9022025-01-14T22:28:23.376ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893701.8318987, correction: -0.350428015 } file = sled-agent/src/rack_setup/service.rs:743
9032025-01-14T22:28:23.376ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9042025-01-14T22:28:23.955ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9052025-01-14T22:28:23.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58590
9062025-01-14T22:28:23.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58590 req_id = dac1f803-9d5c-45cf-91a3-cc3cb9a693a6 response_code = 200 uri = /timesync
9072025-01-14T22:28:23.965ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893702.0643578, correction: -0.348619491 } file = sled-agent/src/rack_setup/service.rs:743
9082025-01-14T22:28:23.965ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9092025-01-14T22:28:24.752ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1355851588213291876 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9102025-01-14T22:28:24.753ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16242841666557994989 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9112025-01-14T22:28:25.327ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36869
9122025-01-14T22:28:25.327ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36869 req_id = f2de70bf-b9a4-4df4-b2cc-638393981d71 response_code = 200 uri = /baseboard
9132025-01-14T22:28:25.396ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9142025-01-14T22:28:25.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53728
9152025-01-14T22:28:25.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8713 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53728 req_id = 9399a250-7141-4eef-9b80-121aaedfe179 response_code = 200 uri = /timesync
9162025-01-14T22:28:25.407ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893702.0643578, correction: -0.344702929 } file = sled-agent/src/rack_setup/service.rs:743
9172025-01-14T22:28:25.407ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9182025-01-14T22:28:26.458ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1371723932291147185 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9192025-01-14T22:28:26.458ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6903098002638956888 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9202025-01-14T22:28:26.668ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9212025-01-14T22:28:26.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60624
9222025-01-14T22:28:26.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8877 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60624 req_id = f5ea313c-6ebe-47aa-a55b-402f01c3ce15 response_code = 200 uri = /timesync
9232025-01-14T22:28:26.680ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893706.0534725, correction: -0.340425789 } file = sled-agent/src/rack_setup/service.rs:743
9242025-01-14T22:28:26.680ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9252025-01-14T22:28:27.828ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9262025-01-14T22:28:27.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35981
9272025-01-14T22:28:27.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8941 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35981 req_id = cdb6eb6f-c3d9-45d2-88c5-3a745dcd5221 response_code = 200 uri = /timesync
9282025-01-14T22:28:27.841ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893706.7683764, correction: -0.333613694 } file = sled-agent/src/rack_setup/service.rs:743
9292025-01-14T22:28:27.841ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9302025-01-14T22:28:29.879ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11154361167794969718 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9312025-01-14T22:28:29.880ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17311797621590698199 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9322025-01-14T22:28:30.495ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 720958829326993617 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9332025-01-14T22:28:30.973ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15843714721872555246 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9342025-01-14T22:28:31.077ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9352025-01-14T22:28:31.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38094
9362025-01-14T22:28:31.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9307 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38094 req_id = 15c215d1-1da1-4d8d-a350-ead3c1e8e334 response_code = 200 uri = /timesync
9372025-01-14T22:28:31.088ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893709.913025, correction: -0.328907341 } file = sled-agent/src/rack_setup/service.rs:743
9382025-01-14T22:28:31.088ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9392025-01-14T22:28:31.587ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18053398597699293300 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9402025-01-14T22:28:33.375ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9412025-01-14T22:28:33.375ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34008
9422025-01-14T22:28:33.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8723 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34008 req_id = 1349feb8-ab90-4b20-9d5e-bbce7e95a7bb response_code = 200 uri = /timesync
9432025-01-14T22:28:33.387ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893711.6203885, correction: -0.324506342 } file = sled-agent/src/rack_setup/service.rs:743
9442025-01-14T22:28:33.387ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9452025-01-14T22:28:34.727ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1355851588213291876 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9462025-01-14T22:28:34.727ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16242841666557994989 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9472025-01-14T22:28:36.432ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1371723932291147185 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9482025-01-14T22:28:36.433ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6903098002638956888 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9492025-01-14T22:28:36.489ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9502025-01-14T22:28:36.489ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48964
9512025-01-14T22:28:36.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8502 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48964 req_id = 133dd99a-6153-468d-8c2e-53b66f82e88c response_code = 200 uri = /timesync
9522025-01-14T22:28:36.500ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893714.316374, correction: -0.309380263 } file = sled-agent/src/rack_setup/service.rs:743
9532025-01-14T22:28:36.500ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9542025-01-14T22:28:37.549ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 525.910387ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9552025-01-14T22:28:39.680ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9562025-01-14T22:28:39.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57824
9572025-01-14T22:28:39.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8879 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57824 req_id = cfc489d9-2795-4c1e-970a-5e960ab90487 response_code = 200 uri = /timesync
9582025-01-14T22:28:39.691ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893717.102726, correction: -0.304411352 } file = sled-agent/src/rack_setup/service.rs:743
9592025-01-14T22:28:39.691ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9602025-01-14T22:28:39.853ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11154361167794969718 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9612025-01-14T22:28:39.853ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17311797621590698199 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9622025-01-14T22:28:40.469ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 720958829326993617 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9632025-01-14T22:28:40.947ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15843714721872555246 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9642025-01-14T22:28:41.561ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18053398597699293300 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9652025-01-14T22:28:42.376ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9662025-01-14T22:28:42.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42863
9672025-01-14T22:28:42.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8329 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42863 req_id = 292cf19e-b3b5-45b0-b2fe-2b6a5657e7f3 response_code = 200 uri = /timesync
9682025-01-14T22:28:42.389ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893720.4855456, correction: -0.296802908 } file = sled-agent/src/rack_setup/service.rs:743
9692025-01-14T22:28:42.389ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9702025-01-14T22:28:44.702ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1355851588213291876 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9712025-01-14T22:28:44.702ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16242841666557994989 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9722025-01-14T22:28:46.407ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1371723932291147185 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9732025-01-14T22:28:46.407ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6903098002638956888 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9742025-01-14T22:28:46.699ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9752025-01-14T22:28:46.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52484
9762025-01-14T22:28:46.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52484 req_id = e628c719-ec7a-44f0-8bb2-d9768e01a924 response_code = 200 uri = /timesync
9772025-01-14T22:28:46.711ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893723.2390754, correction: -0.285151005 } file = sled-agent/src/rack_setup/service.rs:743
9782025-01-14T22:28:46.711ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9792025-01-14T22:28:49.828ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11154361167794969718 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9802025-01-14T22:28:49.828ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17311797621590698199 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9812025-01-14T22:28:50.444ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 720958829326993617 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9822025-01-14T22:28:50.921ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15843714721872555246 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9832025-01-14T22:28:51.535ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18053398597699293300 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9842025-01-14T22:28:53.068ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 745.01315ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9852025-01-14T22:28:54.676ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 1355851588213291876 reason = Duration(60s) sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9862025-01-14T22:28:54.677ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 16242841666557994989 reason = Duration(60s) sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9872025-01-14T22:28:55.280ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47365
9882025-01-14T22:28:55.280ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47365 req_id = 98d2277d-cf98-4d36-8cd3-a57469a5f23e response_code = 200 uri = /baseboard
9892025-01-14T22:28:55.958ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9902025-01-14T22:28:55.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34024
9912025-01-14T22:28:55.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8819 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34024 req_id = aa6f3748-e35e-4229-a6fe-a643a5443a74 response_code = 200 uri = /timesync
9922025-01-14T22:28:55.970ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893730.2563713, correction: -0.260070682 } file = sled-agent/src/rack_setup/service.rs:743
9932025-01-14T22:28:55.970ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9942025-01-14T22:28:56.382ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1371723932291147185 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9952025-01-14T22:28:56.382ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6903098002638956888 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9962025-01-14T22:28:59.802ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11154361167794969718 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9972025-01-14T22:28:59.802ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17311797621590698199 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
9982025-01-14T22:29:00.228ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9992025-01-14T22:29:00.229ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58478
10002025-01-14T22:29:00.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8343 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58478 req_id = 03525432-76db-4dda-af4b-81623d85450d response_code = 200 uri = /timesync
10012025-01-14T22:29:00.240ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893737.759198, correction: -0.248358056 } file = sled-agent/src/rack_setup/service.rs:743
10022025-01-14T22:29:00.240ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10032025-01-14T22:29:00.419ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 720958829326993617 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10042025-01-14T22:29:00.897ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15843714721872555246 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10052025-01-14T22:29:01.509ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18053398597699293300 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10062025-01-14T22:29:06.357ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1371723932291147185 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10072025-01-14T22:29:06.357ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6903098002638956888 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10082025-01-14T22:29:07.534ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10092025-01-14T22:29:07.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42414
10102025-01-14T22:29:07.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8993 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42414 req_id = 3cae10a4-5cb9-4c1f-9b7a-fca22731df1c response_code = 200 uri = /timesync
10112025-01-14T22:29:07.545ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893742.3786182, correction: -0.228453994 } file = sled-agent/src/rack_setup/service.rs:743
10122025-01-14T22:29:07.545ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10132025-01-14T22:29:08.806ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.380706023s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10142025-01-14T22:29:09.778ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11154361167794969718 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10152025-01-14T22:29:09.778ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17311797621590698199 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10162025-01-14T22:29:10.393ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 720958829326993617 reason = Duration(60s) sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10172025-01-14T22:29:10.872ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 15843714721872555246 reason = Duration(60s) sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10182025-01-14T22:29:11.484ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 18053398597699293300 reason = Duration(60s) sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10192025-01-14T22:29:16.332ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1371723932291147185 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10202025-01-14T22:29:16.332ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6903098002638956888 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10212025-01-14T22:29:16.685ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10222025-01-14T22:29:16.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50250
10232025-01-14T22:29:16.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9063 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50250 req_id = 85f8cfb2-aa52-4739-9f3a-1235a3fd8a8d response_code = 200 uri = /timesync
10242025-01-14T22:29:16.697ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893752.1915405, correction: -0.203603074 } file = sled-agent/src/rack_setup/service.rs:743
10252025-01-14T22:29:16.697ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10262025-01-14T22:29:19.752ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 11154361167794969718 reason = Duration(60s) sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10272025-01-14T22:29:19.752ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 17311797621590698199 reason = Duration(60s) sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10282025-01-14T22:29:25.231ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58663
10292025-01-14T22:29:25.232ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58663 req_id = 402956f7-238c-4768-985c-81543403c01b response_code = 200 uri = /baseboard
10302025-01-14T22:29:26.175ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.168505111s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10312025-01-14T22:29:26.307ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1371723932291147185 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10322025-01-14T22:29:26.307ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6903098002638956888 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10332025-01-14T22:29:26.491ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10342025-01-14T22:29:26.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53211
10352025-01-14T22:29:26.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8695 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53211 req_id = 01bbf01d-8798-439d-9944-a6eb096524bd response_code = 200 uri = /timesync
10362025-01-14T22:29:26.503ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893760.965782, correction: -0.177017197 } file = sled-agent/src/rack_setup/service.rs:743
10372025-01-14T22:29:26.503ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10382025-01-14T22:29:35.431ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10392025-01-14T22:29:35.431ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62823
10402025-01-14T22:29:35.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9059 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62823 req_id = 4b082daa-f841-4e46-8138-33efa2c45f12 response_code = 200 uri = /timesync
10412025-01-14T22:29:35.443ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893768.2941692, correction: -0.152727932 } file = sled-agent/src/rack_setup/service.rs:743
10422025-01-14T22:29:35.443ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10432025-01-14T22:29:36.282ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1371723932291147185 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10442025-01-14T22:29:36.282ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6903098002638956888 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10452025-01-14T22:29:45.328ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.100625411s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10462025-01-14T22:29:46.257ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1371723932291147185 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10472025-01-14T22:29:46.257ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6903098002638956888 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10482025-01-14T22:29:55.185ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50151
10492025-01-14T22:29:55.185ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50151 req_id = 53d060f6-fb62-4642-8831-1c96d1303103 response_code = 200 uri = /baseboard
10502025-01-14T22:29:56.232ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1371723932291147185 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10512025-01-14T22:29:56.233ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6903098002638956888 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10522025-01-14T22:30:01.390ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10532025-01-14T22:30:01.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62768
10542025-01-14T22:30:01.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8671 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62768 req_id = 6f73846d-2443-4e4d-a2f0-7be0bce31193 response_code = 200 uri = /timesync
10552025-01-14T22:30:01.401ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893798.891481, correction: -0.08229167 } file = sled-agent/src/rack_setup/service.rs:743
10562025-01-14T22:30:01.401ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10572025-01-14T22:30:04.413ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 11.514112404s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10582025-01-14T22:30:06.207ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1371723932291147185 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10592025-01-14T22:30:06.208ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6903098002638956888 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10602025-01-14T22:30:16.182ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1371723932291147185 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10612025-01-14T22:30:16.182ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6903098002638956888 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10622025-01-14T22:30:24.896ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10632025-01-14T22:30:24.896ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65096
10642025-01-14T22:30:24.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22300 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65096 req_id = 9b6c0186-dd29-4efb-aaf4-3dd643032351 response_code = 200 uri = /timesync
10652025-01-14T22:30:24.919ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-14T22:29:10.872071057Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 15843714721872555246 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10662025-01-14T22:30:24.920ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-14T22:28:54.677248995Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 16242841666557994989 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10672025-01-14T22:30:24.921ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-14T22:29:11.484843175Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 18053398597699293300 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10682025-01-14T22:30:24.921ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-14T22:29:19.752585376Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 11154361167794969718 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10692025-01-14T22:30:24.921ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-14T22:29:19.752927080Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 17311797621590698199 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10702025-01-14T22:30:24.922ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-14T22:28:54.676728619Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 1355851588213291876 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10712025-01-14T22:30:24.922ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-14T22:29:10.393299205Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 720958829326993617 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
10722025-01-14T22:30:24.924ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2554587143, ip_addr: 152.67.232.7, stratum: 3, ref_time: 1736893819.064528, correction: -0.018378964 } file = sled-agent/src/rack_setup/service.rs:743
10732025-01-14T22:30:24.924ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
10742025-01-14T22:30:24.955ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: bbf0c713-a573-41b3-9c51-a4965b8639a4 (service), filesystem_pool: Some(ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 9d4edcc9-3f8e-4f2d-a69b-18370f25b36c (service), filesystem_pool: Some(ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 9aa50efb-886c-4ee7-9ecb-a39c950f475f (service), filesystem_pool: Some(ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ea402e43-449c-4c8d-9d02-3cca94752675 (service), filesystem_pool: Some(ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 66a5c7c4-05d9-4080-b475-882de1550444, kind: Service { id: ea402e43-449c-4c8d-9d02-3cca94752675 }, name: Name("ntp-ea402e43-449c-4c8d-9d02-3cca94752675"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 189])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: f919930a-2611-44a1-b45b-54804f7eefe4 (service), filesystem_pool: Some(ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 41db6826-b41b-4992-9198-3e4b251cfbc6 (service), filesystem_pool: Some(ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External } } } }, OmicronZoneConfig { id: 874010e6-30ba-41fa-811b-ee1a7622fb3f (service), filesystem_pool: Some(ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External } } } }, OmicronZoneConfig { id: da65828f-55bb-4573-a037-03b0da7fb1c3 (service), filesystem_pool: Some(ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External } } } }, OmicronZoneConfig { id: 84bc1123-8147-4685-8ee7-c827d9de513e (service), filesystem_pool: Some(ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10752025-01-14T22:30:24.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40146
10762025-01-14T22:30:24.955ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10772025-01-14T22:30:24.955ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10782025-01-14T22:30:24.966ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10792025-01-14T22:30:24.966ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10802025-01-14T22:30:24.976ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10812025-01-14T22:30:24.976ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10822025-01-14T22:30:24.985ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10832025-01-14T22:30:24.985ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10842025-01-14T22:30:24.995ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10852025-01-14T22:30:24.995ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10862025-01-14T22:30:25.005ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10872025-01-14T22:30:25.005ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10882025-01-14T22:30:25.014ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10892025-01-14T22:30:25.014ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, kind: Cockroach }, responder: ... }
10902025-01-14T22:30:25.024ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10912025-01-14T22:30:25.024ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10922025-01-14T22:30:25.033ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10932025-01-14T22:30:25.033ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/omicron-zones.json file = common/src/ledger.rs:177
10942025-01-14T22:30:25.033ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/omicron-zones.json file = common/src/ledger.rs:177
10952025-01-14T22:30:25.033ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10962025-01-14T22:30:25.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10972025-01-14T22:30:25.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10982025-01-14T22:30:25.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10992025-01-14T22:30:25.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11002025-01-14T22:30:25.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11012025-01-14T22:30:25.139ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60891
11022025-01-14T22:30:25.142ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60891 req_id = 76a694db-48d5-4e0d-91ef-2550bc49453e response_code = 200 uri = /baseboard
11032025-01-14T22:30:25.213ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6 file = illumos-utils/src/zone.rs:325
11042025-01-14T22:30:25.217ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3 file = illumos-utils/src/zone.rs:325
11052025-01-14T22:30:25.221ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f file = illumos-utils/src/zone.rs:325
11062025-01-14T22:30:25.225ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4 file = illumos-utils/src/zone.rs:325
11072025-01-14T22:30:25.229ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e file = illumos-utils/src/zone.rs:325
11082025-01-14T22:30:25.234ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6 file = illumos-utils/src/zone.rs:363
11092025-01-14T22:30:25.240ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3 file = illumos-utils/src/zone.rs:363
11102025-01-14T22:30:25.244ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f file = illumos-utils/src/zone.rs:363
11112025-01-14T22:30:25.248ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4 file = illumos-utils/src/zone.rs:363
11122025-01-14T22:30:25.252ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e file = illumos-utils/src/zone.rs:363
11132025-01-14T22:30:28.861ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='41db6826-b41b-4992-9198-3e4b251cfbc6'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11142025-01-14T22:30:28.861ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6
11152025-01-14T22:30:28.879ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='874010e6-30ba-41fa-811b-ee1a7622fb3f'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11162025-01-14T22:30:28.879ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f
11172025-01-14T22:30:28.893ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='84bc1123-8147-4685-8ee7-c827d9de513e'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11182025-01-14T22:30:28.893ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e
11192025-01-14T22:30:28.917ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='da65828f-55bb-4573-a037-03b0da7fb1c3'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11202025-01-14T22:30:28.918ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3
11212025-01-14T22:30:28.934ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='f919930a-2611-44a1-b45b-54804f7eefe4'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11222025-01-14T22:30:28.934ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4
11232025-01-14T22:30:29.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6") failed: Property not found. retry in 29.567444ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6
11242025-01-14T22:30:29.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f") failed: Property not found. retry in 48.23162ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f
11252025-01-14T22:30:29.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e") failed: Property not found. retry in 34.96997ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e
11262025-01-14T22:30:29.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6") failed: Property not found. retry in 143.170534ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6
11272025-01-14T22:30:29.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3") failed: Property not found. retry in 55.473249ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3
11282025-01-14T22:30:29.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4") failed: Property not found. retry in 32.305062ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4
11292025-01-14T22:30:29.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e") failed: Property not found. retry in 72.180623ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e
11302025-01-14T22:30:29.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f") failed: Property not found. retry in 139.849334ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f
11312025-01-14T22:30:29.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4") failed: Property not found. retry in 56.111355ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4
11322025-01-14T22:30:29.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6") failed: Property not found. retry in 226.083013ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6
11332025-01-14T22:30:29.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3") failed: Property not found. retry in 87.898187ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3
11342025-01-14T22:30:29.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f") failed: Property not found. retry in 181.177115ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f
11352025-01-14T22:30:29.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4") failed: Property not found. retry in 174.296847ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4
11362025-01-14T22:30:29.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e") failed: Property not found. retry in 129.294107ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e
11372025-01-14T22:30:29.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3") failed: Property not found. retry in 174.012776ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3
11382025-01-14T22:30:29.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e") failed: Property not found. retry in 286.52946ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e
11392025-01-14T22:30:29.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6") failed: Property not found. retry in 568.522307ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6
11402025-01-14T22:30:29.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f") failed: Property not found. retry in 444.457277ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f
11412025-01-14T22:30:29.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4") failed: Property not found. retry in 564.054489ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4
11422025-01-14T22:30:30.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3") failed: Property not found. retry in 536.235631ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3
11432025-01-14T22:30:30.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e") failed: Property not found. retry in 738.92899ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e
11442025-01-14T22:30:30.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f") failed: Property not found. retry in 710.622299ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f
11452025-01-14T22:30:30.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6") failed: Property not found. retry in 621.880032ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6
11462025-01-14T22:30:30.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4") failed: Property not found. retry in 1.039871669s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4
11472025-01-14T22:30:30.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3") failed: Property not found. retry in 1.182432118s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3
11482025-01-14T22:30:30.893ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 16.487510084s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
11492025-01-14T22:30:30.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e") failed: Property not found. retry in 1.313515653s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e
11502025-01-14T22:30:31.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f") failed: Property not found. retry in 1.172306045s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f
11512025-01-14T22:30:31.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6") failed: Property not found. retry in 1.264667752s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6
11522025-01-14T22:30:31.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4") failed: Property not found. retry in 1.256426953s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4
11532025-01-14T22:30:31.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3") failed: Property not found. retry in 941.616896ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3
11542025-01-14T22:30:32.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e") failed: Property not found. retry in 1.098392232s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e
11552025-01-14T22:30:32.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f") failed: Property not found. retry in 1.480733705s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f
11562025-01-14T22:30:32.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6") failed: Property not found. retry in 1.071935408s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6
11572025-01-14T22:30:32.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3") failed: Property not found. retry in 1.015029681s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3
11582025-01-14T22:30:32.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4") failed: Property not found. retry in 835.603252ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4
11592025-01-14T22:30:33.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e") failed: Property not found. retry in 1.432083399s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e
11602025-01-14T22:30:33.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6") failed: Property not found. retry in 725.297175ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6
11612025-01-14T22:30:33.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4") failed: Property not found. retry in 1.284924635s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4
11622025-01-14T22:30:33.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3") failed: Property not found. retry in 1.416366881s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3
11632025-01-14T22:30:33.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f") failed: Property not found. retry in 840.495157ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f
11642025-01-14T22:30:34.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6") failed: Property not found. retry in 860.619559ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6
11652025-01-14T22:30:34.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f") failed: Property not found. retry in 822.716641ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f
11662025-01-14T22:30:34.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e") failed: Property not found. retry in 1.046951006s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e
11672025-01-14T22:30:35.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4") failed: Property not found. retry in 1.215685067s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4
11682025-01-14T22:30:35.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6") failed: Property not found. retry in 1.426004469s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6
11692025-01-14T22:30:35.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3") failed: Property not found. retry in 755.908996ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3
11702025-01-14T22:30:35.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f") failed: Property not found. retry in 785.249347ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f
11712025-01-14T22:30:36.582ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6
11722025-01-14T22:30:36.582ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_da65828f-55bb-4573-a037-03b0da7fb1c3
11732025-01-14T22:30:36.582ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_874010e6-30ba-41fa-811b-ee1a7622fb3f
11742025-01-14T22:30:36.582ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_f919930a-2611-44a1-b45b-54804f7eefe4
11752025-01-14T22:30:36.582ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_84bc1123-8147-4685-8ee7-c827d9de513e
11762025-01-14T22:30:36.582ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11772025-01-14T22:30:36.583ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11782025-01-14T22:30:36.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11646215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:40146 req_id = a2c0f495-5139-460c-bed0-57543d3d0d48 response_code = 204 uri = /omicron-zones
11792025-01-14T22:30:36.618ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63046
11802025-01-14T22:30:36.651ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 32758 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63046 req_id = 128caddf-e020-4175-98ba-d86666a20672 response_code = 500 uri = /cockroachdb
11812025-01-14T22:30:36.651ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "128caddf-e020-4175-98ba-d86666a20672", "content-length": "124", "date": "Tue, 14 Jan 2025 22:30:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "128caddf-e020-4175-98ba-d86666a20672" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 108.077099ms
11822025-01-14T22:30:36.790ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29423 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63046 req_id = a3c1d47d-6326-42a7-9d12-d0cc21660f18 response_code = 500 uri = /cockroachdb
11832025-01-14T22:30:36.790ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a3c1d47d-6326-42a7-9d12-d0cc21660f18", "content-length": "124", "date": "Tue, 14 Jan 2025 22:30:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a3c1d47d-6326-42a7-9d12-d0cc21660f18" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 69.488965ms
11842025-01-14T22:30:36.888ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27335 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63046 req_id = 7cbbfbed-e4e2-49a7-bfbb-4375003746fb response_code = 500 uri = /cockroachdb
11852025-01-14T22:30:36.888ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7cbbfbed-e4e2-49a7-bfbb-4375003746fb", "content-length": "124", "date": "Tue, 14 Jan 2025 22:30:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7cbbfbed-e4e2-49a7-bfbb-4375003746fb" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 155.035875ms
11862025-01-14T22:30:37.069ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_41db6826-b41b-4992-9198-3e4b251cfbc6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25243 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63046 req_id = 57cdfcd2-310a-4460-91ea-7ac14d12f26b response_code = 500 uri = /cockroachdb
11872025-01-14T22:30:37.070ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "57cdfcd2-310a-4460-91ea-7ac14d12f26b", "content-length": "124", "date": "Tue, 14 Jan 2025 22:30:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "57cdfcd2-310a-4460-91ea-7ac14d12f26b" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 233.41884ms
11882025-01-14T22:30:37.337ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::4]:32221 file = sled-agent/src/services.rs:3769
11892025-01-14T22:30:47.554ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3787
11902025-01-14T22:30:51.470ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3810
11912025-01-14T22:30:51.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14165325 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63046 req_id = c6f5da81-f74f-41ec-9e92-8b26be20e03b response_code = 204 uri = /cockroachdb
11922025-01-14T22:30:51.545ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: bbf0c713-a573-41b3-9c51-a4965b8639a4 (service), filesystem_pool: Some(ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 9d4edcc9-3f8e-4f2d-a69b-18370f25b36c (service), filesystem_pool: Some(ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 9aa50efb-886c-4ee7-9ecb-a39c950f475f (service), filesystem_pool: Some(ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ea402e43-449c-4c8d-9d02-3cca94752675 (service), filesystem_pool: Some(ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 66a5c7c4-05d9-4080-b475-882de1550444, kind: Service { id: ea402e43-449c-4c8d-9d02-3cca94752675 }, name: Name("ntp-ea402e43-449c-4c8d-9d02-3cca94752675"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 189])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: f919930a-2611-44a1-b45b-54804f7eefe4 (service), filesystem_pool: Some(ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 41db6826-b41b-4992-9198-3e4b251cfbc6 (service), filesystem_pool: Some(ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External } } } }, OmicronZoneConfig { id: 874010e6-30ba-41fa-811b-ee1a7622fb3f (service), filesystem_pool: Some(ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External } } } }, OmicronZoneConfig { id: da65828f-55bb-4573-a037-03b0da7fb1c3 (service), filesystem_pool: Some(ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External } } } }, OmicronZoneConfig { id: 84bc1123-8147-4685-8ee7-c827d9de513e (service), filesystem_pool: Some(ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External } } } }, OmicronZoneConfig { id: a66dcc60-1225-4e39-ab1a-b70caf5209e9 (service), filesystem_pool: Some(ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 08ab3e6f-8169-4727-9bfd-8dd0f022af2c, kind: Service { id: a66dcc60-1225-4e39-ab1a-b70caf5209e9 }, name: Name("external-dns-a66dcc60-1225-4e39-ab1a-b70caf5209e9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 696becfd-808e-490f-8687-0b1b89035dda (service), filesystem_pool: Some(ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: cd47cf7f-251c-4290-8688-7e2060f2050c, kind: Service { id: 696becfd-808e-490f-8687-0b1b89035dda }, name: Name("external-dns-696becfd-808e-490f-8687-0b1b89035dda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 187])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 3203df94-bda8-401f-99df-30e90a5f076d (service), filesystem_pool: Some(ZpoolName { id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 922e49e1-e5c9-4471-b22f-5e46cae983ea, kind: Service { id: 3203df94-bda8-401f-99df-30e90a5f076d }, name: Name("nexus-3203df94-bda8-401f-99df-30e90a5f076d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: e1b2ab23-7976-4ea8-a2a7-c53e015d5764 (service), filesystem_pool: Some(ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 0db76917-acaf-4b6b-8dbb-d22b559cd940, kind: Service { id: e1b2ab23-7976-4ea8-a2a7-c53e015d5764 }, name: Name("nexus-e1b2ab23-7976-4ea8-a2a7-c53e015d5764"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: b0506d4d-8223-4315-9fa0-31e028a676f3 (service), filesystem_pool: Some(ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 9ca98b6d-c3b4-4bfe-a1f8-0d99a0a5ce6f, kind: Service { id: b0506d4d-8223-4315-9fa0-31e028a676f3 }, name: Name("nexus-b0506d4d-8223-4315-9fa0-31e028a676f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: f007913c-5161-449b-84f0-9bb0a3039117 (service), filesystem_pool: Some(ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 98a3c45a-da7a-4517-8dbd-f5f13329260a (service), filesystem_pool: Some(ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External } } } }, OmicronZoneConfig { id: faaf481b-b6d5-471e-8caf-838aade7233a (service), filesystem_pool: Some(ZpoolName { id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: a5e79091-da12-4135-aa4c-900d05bdaeef (service), filesystem_pool: Some(ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 3e4d0c49-0a7f-48e2-8626-a0a2544a44d6 (service), filesystem_pool: Some(ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 30e50de8-9abb-4694-9323-eb0bf0dd650d (service), filesystem_pool: Some(ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9a877f4f-9e4e-47af-b776-789d43b9d042 (service), filesystem_pool: Some(ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External } } } }, OmicronZoneConfig { id: 71b43421-d509-416e-9505-4ed299f6cb19 (service), filesystem_pool: Some(ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5ea310f0-55b2-45b2-91e6-61560e920cc4 (service), filesystem_pool: Some(ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External } } } }, OmicronZoneConfig { id: db349e57-b4e4-49a0-96f1-8edc47a91a12 (service), filesystem_pool: Some(ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External } } } }, OmicronZoneConfig { id: 33b9f277-2724-4fde-9002-469a6a2a2f03 (service), filesystem_pool: Some(ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External } } } }, OmicronZoneConfig { id: 505f69b7-006c-4177-84d9-954cc0c52f8d (service), filesystem_pool: Some(ZpoolName { id: a77abd92-fef1-4271-b3d6-7b70ec3d579b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a77abd92-fef1-4271-b3d6-7b70ec3d579b (zpool), kind: External } } } }, OmicronZoneConfig { id: c1c1faca-128a-4fbc-9305-aff02770e047 (service), filesystem_pool: Some(ZpoolName { id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool), kind: External } } } }, OmicronZoneConfig { id: 53e6c282-39fc-4639-b8af-1e3c120b5a86 (service), filesystem_pool: Some(ZpoolName { id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
11932025-01-14T22:30:51.546ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51853
11942025-01-14T22:30:51.547ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11952025-01-14T22:30:51.547ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11962025-01-14T22:30:51.560ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11972025-01-14T22:30:51.560ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11982025-01-14T22:30:51.571ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11992025-01-14T22:30:51.571ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
12002025-01-14T22:30:51.582ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12012025-01-14T22:30:51.582ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12022025-01-14T22:30:51.592ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12032025-01-14T22:30:51.592ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12042025-01-14T22:30:51.602ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12052025-01-14T22:30:51.602ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12062025-01-14T22:30:51.612ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12072025-01-14T22:30:51.612ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, kind: Cockroach }, responder: ... }
12082025-01-14T22:30:51.621ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12092025-01-14T22:30:51.622ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12102025-01-14T22:30:51.631ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12112025-01-14T22:30:51.631ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12122025-01-14T22:30:51.642ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12132025-01-14T22:30:51.642ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12142025-01-14T22:30:51.653ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
12152025-01-14T22:30:51.653ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
12162025-01-14T22:30:51.663ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12172025-01-14T22:30:51.663ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, kind: Crucible }, responder: ... }
12182025-01-14T22:30:51.673ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12192025-01-14T22:30:51.673ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, kind: Crucible }, responder: ... }
12202025-01-14T22:30:51.682ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12212025-01-14T22:30:51.683ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, kind: Crucible }, responder: ... }
12222025-01-14T22:30:51.692ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12232025-01-14T22:30:51.692ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, kind: Crucible }, responder: ... }
12242025-01-14T22:30:51.702ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12252025-01-14T22:30:51.702ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }, kind: Crucible }, responder: ... }
12262025-01-14T22:30:51.713ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12272025-01-14T22:30:51.713ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External }, kind: Crucible }, responder: ... }
12282025-01-14T22:30:51.723ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a77abd92-fef1-4271-b3d6-7b70ec3d579b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12292025-01-14T22:30:51.723ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a77abd92-fef1-4271-b3d6-7b70ec3d579b (zpool), kind: External }, kind: Crucible }, responder: ... }
12302025-01-14T22:30:51.734ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12312025-01-14T22:30:51.734ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool), kind: External }, kind: Crucible }, responder: ... }
12322025-01-14T22:30:51.745ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12332025-01-14T22:30:51.745ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool), kind: External }, kind: Crucible }, responder: ... }
12342025-01-14T22:30:51.755ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12352025-01-14T22:30:51.755ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/omicron-zones.json file = common/src/ledger.rs:177
12362025-01-14T22:30:51.755ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/omicron-zones.json file = common/src/ledger.rs:177
12372025-01-14T22:30:51.756ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12382025-01-14T22:30:51.891ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12392025-01-14T22:30:51.892ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12402025-01-14T22:30:51.892ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12412025-01-14T22:30:51.892ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12422025-01-14T22:30:51.893ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12432025-01-14T22:30:51.921ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12442025-01-14T22:30:51.921ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12452025-01-14T22:30:51.921ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12462025-01-14T22:30:51.960ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12472025-01-14T22:30:51.960ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12482025-01-14T22:30:52.141ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12492025-01-14T22:30:52.141ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12502025-01-14T22:30:52.141ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12512025-01-14T22:30:52.141ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12522025-01-14T22:30:52.141ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12532025-01-14T22:30:52.141ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12542025-01-14T22:30:52.170ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12552025-01-14T22:30:52.170ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12562025-01-14T22:30:52.170ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12572025-01-14T22:30:52.170ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19 file = illumos-utils/src/zone.rs:325
12582025-01-14T22:30:52.175ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86 file = illumos-utils/src/zone.rs:325
12592025-01-14T22:30:52.180ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6 file = illumos-utils/src/zone.rs:325
12602025-01-14T22:30:52.186ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a file = illumos-utils/src/zone.rs:325
12612025-01-14T22:30:52.192ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a file = illumos-utils/src/zone.rs:325
12622025-01-14T22:30:52.197ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4 file = illumos-utils/src/zone.rs:325
12632025-01-14T22:30:52.202ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12 file = illumos-utils/src/zone.rs:325
12642025-01-14T22:30:52.353ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19 file = illumos-utils/src/zone.rs:363
12652025-01-14T22:30:52.358ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86 file = illumos-utils/src/zone.rs:363
12662025-01-14T22:30:52.364ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6 file = illumos-utils/src/zone.rs:363
12672025-01-14T22:30:52.369ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a file = illumos-utils/src/zone.rs:363
12682025-01-14T22:30:52.373ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a file = illumos-utils/src/zone.rs:363
12692025-01-14T22:30:52.378ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4 file = illumos-utils/src/zone.rs:363
12702025-01-14T22:30:52.383ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12 file = illumos-utils/src/zone.rs:363
12712025-01-14T22:30:52.388ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03 file = illumos-utils/src/zone.rs:325
12722025-01-14T22:30:52.393ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d file = illumos-utils/src/zone.rs:325
12732025-01-14T22:30:52.398ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117 file = illumos-utils/src/zone.rs:325
12742025-01-14T22:30:52.404ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d file = illumos-utils/src/zone.rs:325
12752025-01-14T22:30:52.409ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef file = illumos-utils/src/zone.rs:325
12762025-01-14T22:30:52.416ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042 file = illumos-utils/src/zone.rs:325
12772025-01-14T22:30:52.423ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047 file = illumos-utils/src/zone.rs:325
12782025-01-14T22:30:52.496ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12792025-01-14T22:30:52.497ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03 file = illumos-utils/src/zone.rs:363
12802025-01-14T22:30:52.533ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d file = illumos-utils/src/zone.rs:363
12812025-01-14T22:30:52.557ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117 file = illumos-utils/src/zone.rs:363
12822025-01-14T22:30:52.567ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d file = illumos-utils/src/zone.rs:363
12832025-01-14T22:30:52.576ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef file = illumos-utils/src/zone.rs:363
12842025-01-14T22:30:52.584ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042 file = illumos-utils/src/zone.rs:363
12852025-01-14T22:30:52.593ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047 file = illumos-utils/src/zone.rs:363
12862025-01-14T22:30:52.662ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12872025-01-14T22:30:52.722ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12882025-01-14T22:30:52.793ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12892025-01-14T22:30:52.860ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12902025-01-14T22:30:52.865ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12912025-01-14T22:30:52.866ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12922025-01-14T22:30:52.924ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 149, 143]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12932025-01-14T22:30:52.924ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
12942025-01-14T22:30:52.932ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12952025-01-14T22:30:52.932ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12962025-01-14T22:30:53.024ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 243, 101]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12972025-01-14T22:30:53.024ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
12982025-01-14T22:30:53.032ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12992025-01-14T22:30:53.032ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13002025-01-14T22:30:53.306ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 214, 171]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13012025-01-14T22:30:53.306ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = external_dns
13022025-01-14T22:30:53.312ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13032025-01-14T22:30:53.312ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13042025-01-14T22:30:53.479ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 196, 187]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13052025-01-14T22:30:53.479ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = external_dns
13062025-01-14T22:30:53.482ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13072025-01-14T22:30:53.482ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13082025-01-14T22:30:53.622ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 187, 95]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13092025-01-14T22:30:53.622ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
13102025-01-14T22:30:53.623ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
13112025-01-14T22:30:53.623ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
13122025-01-14T22:30:53.624ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
13132025-01-14T22:30:53.624ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
13142025-01-14T22:30:53.694ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
13152025-01-14T22:30:53.696ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13162025-01-14T22:30:53.773ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
13172025-01-14T22:30:53.777ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13182025-01-14T22:30:53.777ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
13192025-01-14T22:30:53.777ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
13202025-01-14T22:30:53.777ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
13212025-01-14T22:30:53.777ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
13222025-01-14T22:30:53.777ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
13232025-01-14T22:30:53.777ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
13242025-01-14T22:30:53.831ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
13252025-01-14T22:30:53.835ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
13262025-01-14T22:30:53.838ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
13272025-01-14T22:30:53.839ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13282025-01-14T22:30:53.839ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13292025-01-14T22:30:53.842ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13302025-01-14T22:30:53.843ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d file = illumos-utils/src/zone.rs:325
13312025-01-14T22:30:53.855ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3 file = illumos-utils/src/zone.rs:325
13322025-01-14T22:30:54.008ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d file = illumos-utils/src/zone.rs:363
13332025-01-14T22:30:54.017ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3 file = illumos-utils/src/zone.rs:363
13342025-01-14T22:30:54.027ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9 file = illumos-utils/src/zone.rs:325
13352025-01-14T22:30:54.039ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda file = illumos-utils/src/zone.rs:325
13362025-01-14T22:30:54.051ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764 file = illumos-utils/src/zone.rs:325
13372025-01-14T22:30:54.076ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9 file = illumos-utils/src/zone.rs:363
13382025-01-14T22:30:54.084ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda file = illumos-utils/src/zone.rs:363
13392025-01-14T22:30:54.091ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764 file = illumos-utils/src/zone.rs:363
13402025-01-14T22:30:55.710ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55732
13412025-01-14T22:30:55.721ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 402 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55732 req_id = 92ef08d1-8178-47da-bbe7-b3932c03be1e response_code = 200 uri = /baseboard
13422025-01-14T22:30:55.934ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13432025-01-14T22:30:55.934ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
13442025-01-14T22:31:03.297ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f72d9943-3b41-40fd-968b-8debb9d0e66b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b329609e-b5ff-48e1-ace5-2b2d257d9d71'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13452025-01-14T22:31:03.297ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
13462025-01-14T22:31:03.344ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ebeecaa7-8727-491c-81b6-8ff8177ba2c6/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3f4a5860-ba3b-46d9-9000-2140d0119a91'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13472025-01-14T22:31:03.344ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2feae34e-6ca4-4ceb-91e2-ab42367be653'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13482025-01-14T22:31:03.351ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_42c887d6-10d1-4b8b-a7bb-82239cc2998c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='11f08bc7-825e-48ed-bbcb-90bdd87d385b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13492025-01-14T22:31:03.351ZINFOSledAgent (ServiceManager): Booting oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
13502025-01-14T22:31:03.383ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
13512025-01-14T22:31:03.430ZINFOSledAgent (ServiceManager): Booting oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
13522025-01-14T22:31:03.464ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_193d38c2-fbe5-4b1d-95c5-92a256ddffe2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9140aa09-d3c4-4482-a43c-24c852db24cc'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13532025-01-14T22:31:03.474ZINFOSledAgent (ServiceManager): Booting oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
13542025-01-14T22:31:03.621ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a77abd92-fef1-4271-b3d6-7b70ec3d579b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='bb654e0e-1af1-4d58-85a9-d4c205a0225a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13552025-01-14T22:31:03.621ZINFOSledAgent (ServiceManager): Booting oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
13562025-01-14T22:31:04.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a") failed: Property not found. retry in 62.925012ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
13572025-01-14T22:31:04.066ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_17026a0f-546c-4e8b-87e1-2bef866e5f38/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='34d5eb6e-44f8-43a8-90ac-d260594e82d1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13582025-01-14T22:31:04.070ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
13592025-01-14T22:31:04.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 72.981055ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
13602025-01-14T22:31:04.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a") failed: Property not found. retry in 76.946224ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
13612025-01-14T22:31:04.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 46.390497ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
13622025-01-14T22:31:04.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 62.908681ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
13632025-01-14T22:31:04.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 42.395087ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
13642025-01-14T22:31:04.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 29.527492ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
13652025-01-14T22:31:04.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 122.547072ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
13662025-01-14T22:31:04.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19") failed: Property not found. retry in 41.568504ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
13672025-01-14T22:31:04.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 135.677941ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
13682025-01-14T22:31:04.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a") failed: Property not found. retry in 275.612234ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
13692025-01-14T22:31:04.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 133.992499ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
13702025-01-14T22:31:04.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 133.998878ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
13712025-01-14T22:31:04.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 149.866154ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
13722025-01-14T22:31:04.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19") failed: Property not found. retry in 65.882081ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
13732025-01-14T22:31:04.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 259.752858ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
13742025-01-14T22:31:04.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 263.790343ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
13752025-01-14T22:31:04.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19") failed: Property not found. retry in 154.154913ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
13762025-01-14T22:31:04.375ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1d7f3095-551d-4b38-ab75-41ab8164b7e8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13772025-01-14T22:31:04.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 100.976119ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
13782025-01-14T22:31:04.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 221.425878ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
13792025-01-14T22:31:04.403ZINFOSledAgent (ServiceManager): Booting oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
13802025-01-14T22:31:04.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 57.517625ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
13812025-01-14T22:31:04.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 213.345659ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
13822025-01-14T22:31:04.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 99.912516ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
13832025-01-14T22:31:04.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 314.570348ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
13842025-01-14T22:31:04.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a") failed: Property not found. retry in 408.024869ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
13852025-01-14T22:31:04.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19") failed: Property not found. retry in 402.168678ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
13862025-01-14T22:31:04.547ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='f007913c-5161-449b-84f0-9bb0a3039117'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13872025-01-14T22:31:04.549ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
13882025-01-14T22:31:04.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 306.960725ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
13892025-01-14T22:31:04.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 162.331437ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
13902025-01-14T22:31:04.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 553.077231ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
13912025-01-14T22:31:04.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 253.018947ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
13922025-01-14T22:31:04.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 506.013012ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
13932025-01-14T22:31:04.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d") failed: Property not found. retry in 54.165148ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
13942025-01-14T22:31:04.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d") failed: Property not found. retry in 145.32693ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
13952025-01-14T22:31:04.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 312.95884ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
13962025-01-14T22:31:04.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 866.392453ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
13972025-01-14T22:31:04.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 55.589219ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
13982025-01-14T22:31:04.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d") failed: Property not found. retry in 267.272951ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
13992025-01-14T22:31:04.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 679.838838ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
14002025-01-14T22:31:04.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 92.705008ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
14012025-01-14T22:31:04.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 1.169511291s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
14022025-01-14T22:31:04.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19") failed: Property not found. retry in 1.16733268s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
14032025-01-14T22:31:04.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a") failed: Property not found. retry in 590.277425ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
14042025-01-14T22:31:05.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 183.855064ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
14052025-01-14T22:31:05.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 463.34603ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
14062025-01-14T22:31:05.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 482.860342ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
14072025-01-14T22:31:05.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d") failed: Property not found. retry in 492.948379ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
14082025-01-14T22:31:05.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 747.999932ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
14092025-01-14T22:31:05.230ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14102025-01-14T22:31:05.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 519.894926ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
14112025-01-14T22:31:05.251ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
14122025-01-14T22:31:05.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9") failed: Property not found. retry in 43.925085ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
14132025-01-14T22:31:05.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 615.047647ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
14142025-01-14T22:31:05.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a") failed: Property not found. retry in 1.188833677s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
14152025-01-14T22:31:05.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 1.37942059s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
14162025-01-14T22:31:05.745ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14172025-01-14T22:31:05.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9") failed: Property not found. retry in 101.742562ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
14182025-01-14T22:31:05.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 1.160109377s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
14192025-01-14T22:31:05.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 1.111772032s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
14202025-01-14T22:31:05.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 544.607163ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
14212025-01-14T22:31:05.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d") failed: Property not found. retry in 818.05008ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
14222025-01-14T22:31:05.856ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
14232025-01-14T22:31:05.870ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_489724fa-785f-4f35-bb0f-34adf6a09482/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e9b60af1-4638-4151-91d4-c2da15f8104d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14242025-01-14T22:31:05.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9") failed: Property not found. retry in 113.111071ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
14252025-01-14T22:31:05.888ZINFOSledAgent (ServiceManager): Booting oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
14262025-01-14T22:31:05.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 1.454648289s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
14272025-01-14T22:31:06.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9") failed: Property not found. retry in 491.307475ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
14282025-01-14T22:31:06.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6") failed: Property not found. retry in 68.614071ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
14292025-01-14T22:31:06.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 596.052409ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
14302025-01-14T22:31:06.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19") failed: Property not found. retry in 1.123044625s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
14312025-01-14T22:31:06.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 34.694564ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
14322025-01-14T22:31:06.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6") failed: Property not found. retry in 93.904378ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
14332025-01-14T22:31:06.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 111.164391ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
14342025-01-14T22:31:06.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6") failed: Property not found. retry in 293.096135ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
14352025-01-14T22:31:06.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 160.326831ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
14362025-01-14T22:31:06.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 685.221687ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
14372025-01-14T22:31:06.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 764.21301ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
14382025-01-14T22:31:06.417ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14392025-01-14T22:31:06.417ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14402025-01-14T22:31:06.417ZINFOSledAgent (ServiceManager): Booting oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
14412025-01-14T22:31:06.424ZINFOSledAgent (ServiceManager): Booting oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
14422025-01-14T22:31:06.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 582.48903ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
14432025-01-14T22:31:06.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9") failed: Property not found. retry in 1.153568353s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
14442025-01-14T22:31:06.632ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 83.332250135s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
14452025-01-14T22:31:06.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6") failed: Property not found. retry in 479.1256ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
14462025-01-14T22:31:06.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 72.712284ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
14472025-01-14T22:31:06.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 50.599722ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
14482025-01-14T22:31:06.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d") failed: Property not found. retry in 1.294655887s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
14492025-01-14T22:31:06.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 83.645559ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
14502025-01-14T22:31:06.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 106.89918ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
14512025-01-14T22:31:06.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 1.402351651s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
14522025-01-14T22:31:06.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 200.972873ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
14532025-01-14T22:31:06.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 173.561883ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
14542025-01-14T22:31:06.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a") failed: Property not found. retry in 1.17607262s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
14552025-01-14T22:31:06.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 621.360184ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
14562025-01-14T22:31:06.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 1.449834669s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
14572025-01-14T22:31:07.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 628.633056ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
14582025-01-14T22:31:07.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 586.696458ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
14592025-01-14T22:31:07.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 405.62076ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
14602025-01-14T22:31:07.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 745.955879ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
14612025-01-14T22:31:07.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 542.992119ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
14622025-01-14T22:31:07.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6") failed: Property not found. retry in 1.101131715s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
14632025-01-14T22:31:07.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 773.047691ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
14642025-01-14T22:31:07.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19") failed: Property not found. retry in 604.075177ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
14652025-01-14T22:31:07.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 661.95272ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
14662025-01-14T22:31:07.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 918.088876ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
14672025-01-14T22:31:07.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 1.364499207s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
14682025-01-14T22:31:07.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 996.123991ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
14692025-01-14T22:31:07.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 1.173319005s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
14702025-01-14T22:31:07.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 1.271506657s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
14712025-01-14T22:31:07.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9") failed: Property not found. retry in 1.019739188s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
14722025-01-14T22:31:07.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 1.266251105s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
14732025-01-14T22:31:07.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19") failed: Property not found. retry in 544.705612ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
14742025-01-14T22:31:07.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 1.413988405s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
14752025-01-14T22:31:07.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d") failed: Property not found. retry in 1.282554086s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
14762025-01-14T22:31:08.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a") failed: Property not found. retry in 1.102798925s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
14772025-01-14T22:31:08.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 991.988064ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
14782025-01-14T22:31:08.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 936.554733ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
14792025-01-14T22:31:08.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6") failed: Property not found. retry in 1.221092588s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
14802025-01-14T22:31:08.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 852.726803ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
14812025-01-14T22:31:08.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 939.949831ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
14822025-01-14T22:31:08.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19") failed: Property not found. retry in 577.358219ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
14832025-01-14T22:31:08.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 1.030553752s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
14842025-01-14T22:31:08.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9") failed: Property not found. retry in 1.257404743s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
14852025-01-14T22:31:08.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 1.365311128s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
14862025-01-14T22:31:08.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 1.140572616s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
14872025-01-14T22:31:08.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 778.773902ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
14882025-01-14T22:31:09.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19") failed: Property not found. retry in 1.116917404s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
14892025-01-14T22:31:09.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 819.552585ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
14902025-01-14T22:31:09.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 983.366741ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
14912025-01-14T22:31:09.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 1.442804327s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
14922025-01-14T22:31:09.243ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14932025-01-14T22:31:09.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a") failed: Property not found. retry in 952.402369ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
14942025-01-14T22:31:09.258ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda
14952025-01-14T22:31:09.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d") failed: Property not found. retry in 1.031963811s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
14962025-01-14T22:31:09.360ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14972025-01-14T22:31:09.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 663.307049ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
14982025-01-14T22:31:09.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 848.71436ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
14992025-01-14T22:31:09.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 1.208984508s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
15002025-01-14T22:31:09.405ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef
15012025-01-14T22:31:09.412ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15022025-01-14T22:31:09.418ZINFOSledAgent (ServiceManager): Booting oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3
15032025-01-14T22:31:09.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6") failed: Property not found. retry in 1.39783453s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
15042025-01-14T22:31:09.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda") failed: Property not found. retry in 31.938709ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda
15052025-01-14T22:31:09.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda") failed: Property not found. retry in 95.763454ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda
15062025-01-14T22:31:09.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 1.140039412s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
15072025-01-14T22:31:09.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3") failed: Property not found. retry in 26.582592ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3
15082025-01-14T22:31:09.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda") failed: Property not found. retry in 195.302377ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda
15092025-01-14T22:31:09.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3") failed: Property not found. retry in 89.460528ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3
15102025-01-14T22:31:09.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 1.143637898s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
15112025-01-14T22:31:09.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3") failed: Property not found. retry in 166.116303ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3
15122025-01-14T22:31:09.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda") failed: Property not found. retry in 252.166616ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda
15132025-01-14T22:31:09.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 984.623599ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
15142025-01-14T22:31:09.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef") failed: Property not found. retry in 73.420769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef
15152025-01-14T22:31:10.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3") failed: Property not found. retry in 224.344466ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3
15162025-01-14T22:31:10.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 1.077590724s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
15172025-01-14T22:31:10.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9") failed: Property not found. retry in 674.466031ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
15182025-01-14T22:31:10.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef") failed: Property not found. retry in 105.980181ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef
15192025-01-14T22:31:10.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 560.034774ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
15202025-01-14T22:31:10.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 1.175476227s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
15212025-01-14T22:31:10.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19") failed: Property not found. retry in 1.384713412s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
15222025-01-14T22:31:10.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef") failed: Property not found. retry in 261.73669ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef
15232025-01-14T22:31:10.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda") failed: Property not found. retry in 789.720648ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda
15242025-01-14T22:31:10.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a") failed: Property not found. retry in 1.42331064s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
15252025-01-14T22:31:10.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 1.299987194s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
15262025-01-14T22:31:10.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 962.603144ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
15272025-01-14T22:31:10.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3") failed: Property not found. retry in 1.149058956s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3
15282025-01-14T22:31:10.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d") failed: Property not found. retry in 1.408319041s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
15292025-01-14T22:31:10.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef") failed: Property not found. retry in 318.293801ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef
15302025-01-14T22:31:10.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 502.82385ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
15312025-01-14T22:31:10.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 601.582983ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
15322025-01-14T22:31:10.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 613.24685ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
15332025-01-14T22:31:10.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9") failed: Property not found. retry in 1.190408146s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
15342025-01-14T22:31:10.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef") failed: Property not found. retry in 535.561401ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef
15352025-01-14T22:31:10.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 1.066179455s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
15362025-01-14T22:31:10.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6") failed: Property not found. retry in 562.409996ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
15372025-01-14T22:31:10.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 797.323468ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
15382025-01-14T22:31:10.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 793.660901ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
15392025-01-14T22:31:11.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda") failed: Property not found. retry in 1.363751133s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda
15402025-01-14T22:31:11.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 592.299515ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
15412025-01-14T22:31:11.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 1.090634405s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
15422025-01-14T22:31:11.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 542.456784ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
15432025-01-14T22:31:11.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 1.256266016s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
15442025-01-14T22:31:11.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 1.399090522s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
15452025-01-14T22:31:11.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 702.642148ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
15462025-01-14T22:31:11.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef") failed: Property not found. retry in 817.653435ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef
15472025-01-14T22:31:11.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3") failed: Property not found. retry in 806.4478ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3
15482025-01-14T22:31:11.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6") failed: Property not found. retry in 1.020200877s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
15492025-01-14T22:31:11.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 887.220386ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
15502025-01-14T22:31:11.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19") failed: Property not found. retry in 742.351371ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
15512025-01-14T22:31:11.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a") failed: Property not found. retry in 577.850669ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
15522025-01-14T22:31:11.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 1.322859523s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
15532025-01-14T22:31:11.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 1.013172473s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
15542025-01-14T22:31:11.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 950.531305ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
15552025-01-14T22:31:11.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 517.931239ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
15562025-01-14T22:31:11.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d") failed: Property not found. retry in 1.49941964s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
15572025-01-14T22:31:11.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 749.408044ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
15582025-01-14T22:31:11.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9") failed: Property not found. retry in 562.806346ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
15592025-01-14T22:31:12.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 795.248482ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
15602025-01-14T22:31:12.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef") failed: Property not found. retry in 834.762755ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef
15612025-01-14T22:31:12.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3") failed: Property not found. retry in 649.482512ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3
15622025-01-14T22:31:12.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a") failed: Property not found. retry in 1.130744899s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
15632025-01-14T22:31:12.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 727.145921ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
15642025-01-14T22:31:12.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 885.05628ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
15652025-01-14T22:31:12.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19") failed: Property not found. retry in 1.24981233s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
15662025-01-14T22:31:12.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda") failed: Property not found. retry in 1.207755592s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda
15672025-01-14T22:31:12.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 610.73761ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
15682025-01-14T22:31:12.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6") failed: Property not found. retry in 589.07233ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
15692025-01-14T22:31:12.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 625.707492ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
15702025-01-14T22:31:12.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9") failed: Property not found. retry in 1.464781859s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
15712025-01-14T22:31:12.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 1.106112595s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
15722025-01-14T22:31:12.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 676.11299ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
15732025-01-14T22:31:12.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 877.766189ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
15742025-01-14T22:31:12.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 597.484617ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
15752025-01-14T22:31:12.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 1.241059568s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
15762025-01-14T22:31:12.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3") failed: Property not found. retry in 602.766889ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3
15772025-01-14T22:31:12.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 858.678089ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
15782025-01-14T22:31:13.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef") failed: Property not found. retry in 865.4261ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef
15792025-01-14T22:31:13.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 748.849373ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
15802025-01-14T22:31:13.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 1.067504079s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
15812025-01-14T22:31:13.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6") failed: Property not found. retry in 768.051557ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
15822025-01-14T22:31:13.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 733.671769ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
15832025-01-14T22:31:13.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 1.004443602s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
15842025-01-14T22:31:13.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d") failed: Property not found. retry in 1.262226602s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
15852025-01-14T22:31:13.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 1.183585364s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
15862025-01-14T22:31:13.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a") failed: Property not found. retry in 650.733664ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
15872025-01-14T22:31:13.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 1.47317867s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
15882025-01-14T22:31:13.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3") failed: Property not found. retry in 701.511655ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3
15892025-01-14T22:31:13.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19") failed: Property not found. retry in 758.249843ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
15902025-01-14T22:31:13.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda") failed: Property not found. retry in 1.212520096s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda
15912025-01-14T22:31:13.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 964.879929ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
15922025-01-14T22:31:13.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 788.248496ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
15932025-01-14T22:31:13.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 647.137855ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
15942025-01-14T22:31:13.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 1.261771346s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
15952025-01-14T22:31:13.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6") failed: Property not found. retry in 891.579161ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
15962025-01-14T22:31:13.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 689.447339ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
15972025-01-14T22:31:13.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef") failed: Property not found. retry in 536.242875ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef
15982025-01-14T22:31:14.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9") failed: Property not found. retry in 1.216398163s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
15992025-01-14T22:31:14.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 777.207962ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
16002025-01-14T22:31:14.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 634.990362ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
16012025-01-14T22:31:14.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a") failed: Property not found. retry in 757.991624ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
16022025-01-14T22:31:14.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 996.115541ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
16032025-01-14T22:31:14.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3") failed: Property not found. retry in 532.343775ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3
16042025-01-14T22:31:14.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19") failed: Property not found. retry in 1.286326996s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
16052025-01-14T22:31:14.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef") failed: Property not found. retry in 571.213989ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef
16062025-01-14T22:31:14.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 1.210068325s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
16072025-01-14T22:31:14.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 582.836366ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
16082025-01-14T22:31:14.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 528.398782ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
16092025-01-14T22:31:14.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 693.783085ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
16102025-01-14T22:31:14.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d") failed: Property not found. retry in 1.345782949s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
16112025-01-14T22:31:14.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 610.255185ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
16122025-01-14T22:31:14.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6") failed: Property not found. retry in 563.913438ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
16132025-01-14T22:31:14.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 1.367544799s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
16142025-01-14T22:31:14.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3") failed: Property not found. retry in 689.185915ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3
16152025-01-14T22:31:14.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda") failed: Property not found. retry in 1.325663757s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda
16162025-01-14T22:31:14.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 539.344728ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
16172025-01-14T22:31:14.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a") failed: Property not found. retry in 1.457527109s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
16182025-01-14T22:31:14.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 686.247526ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
16192025-01-14T22:31:15.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef") failed: Property not found. retry in 1.318956566s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef
16202025-01-14T22:31:15.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 792.032622ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
16212025-01-14T22:31:15.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 631.732455ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
16222025-01-14T22:31:15.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 648.06332ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
16232025-01-14T22:31:15.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 978.588679ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
16242025-01-14T22:31:15.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9") failed: Property not found. retry in 793.476581ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
16252025-01-14T22:31:15.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 1.497817621s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
16262025-01-14T22:31:15.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 948.921961ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
16272025-01-14T22:31:15.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6") failed: Property not found. retry in 996.043167ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
16282025-01-14T22:31:15.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 925.608489ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
16292025-01-14T22:31:15.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3") failed: Property not found. retry in 1.230205487s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3
16302025-01-14T22:31:15.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 541.31439ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
16312025-01-14T22:31:15.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19") failed: Property not found. retry in 1.317890127s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
16322025-01-14T22:31:15.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 1.397667179s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
16332025-01-14T22:31:15.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 1.072070193s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
16342025-01-14T22:31:15.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 1.33784719s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
16352025-01-14T22:31:15.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 588.602238ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
16362025-01-14T22:31:16.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d") failed: Property not found. retry in 954.560568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
16372025-01-14T22:31:16.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9") failed: Property not found. retry in 1.499664319s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
16382025-01-14T22:31:16.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 527.602861ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
16392025-01-14T22:31:16.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda") failed: Property not found. retry in 1.326481705s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda
16402025-01-14T22:31:16.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 911.188922ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
16412025-01-14T22:31:16.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 884.340392ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
16422025-01-14T22:31:16.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 1.072264501s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
16432025-01-14T22:31:16.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 866.999952ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
16442025-01-14T22:31:16.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef") failed: Property not found. retry in 1.217908927s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef
16452025-01-14T22:31:16.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6") failed: Property not found. retry in 581.290659ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
16462025-01-14T22:31:16.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a") failed: Property not found. retry in 1.479332586s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
16472025-01-14T22:31:16.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 603.339891ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
16482025-01-14T22:31:16.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 924.208595ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
16492025-01-14T22:31:16.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3") failed: Property not found. retry in 1.190801904s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3
16502025-01-14T22:31:16.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 1.30491478s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
16512025-01-14T22:31:16.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 782.306338ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
16522025-01-14T22:31:16.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6") failed: Property not found. retry in 1.131501106s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
16532025-01-14T22:31:16.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d") failed: Property not found. retry in 578.527416ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
16542025-01-14T22:31:17.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19") failed: Property not found. retry in 1.43649839s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
16552025-01-14T22:31:17.081ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16562025-01-14T22:31:17.083ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a
16572025-01-14T22:31:17.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 1.126054129s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
16582025-01-14T22:31:17.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 1.403630506s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
16592025-01-14T22:31:17.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 1.314827699s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
16602025-01-14T22:31:17.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 1.433259914s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
16612025-01-14T22:31:17.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 741.553714ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
16622025-01-14T22:31:17.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 846.294773ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
16632025-01-14T22:31:17.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a") failed: Property not found. retry in 48.060026ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a
16642025-01-14T22:31:17.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a") failed: Property not found. retry in 106.120456ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a
16652025-01-14T22:31:17.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 1.390133667s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
16662025-01-14T22:31:17.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a") failed: Property not found. retry in 204.812194ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a
16672025-01-14T22:31:17.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda") failed: Property not found. retry in 1.167117321s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda
16682025-01-14T22:31:17.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9") failed: Property not found. retry in 611.658061ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
16692025-01-14T22:31:17.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d") failed: Property not found. retry in 989.647113ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
16702025-01-14T22:31:17.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef") failed: Property not found. retry in 725.460992ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef
16712025-01-14T22:31:17.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 1.232672226s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
16722025-01-14T22:31:17.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 1.390302236s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
16732025-01-14T22:31:17.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a") failed: Property not found. retry in 243.037253ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a
16742025-01-14T22:31:17.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a") failed: Property not found. retry in 1.287289496s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
16752025-01-14T22:31:17.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a") failed: Property not found. retry in 417.695414ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a
16762025-01-14T22:31:17.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 1.356361988s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
16772025-01-14T22:31:17.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3") failed: Property not found. retry in 1.011392608s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3
16782025-01-14T22:31:18.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 938.726144ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
16792025-01-14T22:31:18.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6") failed: Property not found. retry in 1.23367804s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
16802025-01-14T22:31:18.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 779.955323ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
16812025-01-14T22:31:18.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9") failed: Property not found. retry in 840.784008ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
16822025-01-14T22:31:18.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 1.440778062s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
16832025-01-14T22:31:18.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef") failed: Property not found. retry in 515.246958ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef
16842025-01-14T22:31:18.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a") failed: Property not found. retry in 1.452203494s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a
16852025-01-14T22:31:18.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 678.90177ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
16862025-01-14T22:31:18.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19") failed: Property not found. retry in 1.173265195s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
16872025-01-14T22:31:18.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 1.055382393s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
16882025-01-14T22:31:18.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d") failed: Property not found. retry in 926.80218ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
16892025-01-14T22:31:18.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 1.286887016s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
16902025-01-14T22:31:18.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda") failed: Property not found. retry in 610.257612ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda
16912025-01-14T22:31:18.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 678.388453ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
16922025-01-14T22:31:18.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef") failed: Property not found. retry in 1.448656924s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef
16932025-01-14T22:31:18.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 570.810979ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
16942025-01-14T22:31:18.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 519.167604ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
16952025-01-14T22:31:18.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3") failed: Property not found. retry in 1.117545127s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3
16962025-01-14T22:31:19.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9") failed: Property not found. retry in 789.008032ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
16972025-01-14T22:31:19.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 759.262233ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
16982025-01-14T22:31:19.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 956.011613ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
16992025-01-14T22:31:19.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 945.472435ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
17002025-01-14T22:31:19.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a") failed: Property not found. retry in 1.233939291s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
17012025-01-14T22:31:19.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 500.215501ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
17022025-01-14T22:31:19.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda") failed: Property not found. retry in 1.28588559s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda
17032025-01-14T22:31:19.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6") failed: Property not found. retry in 518.344707ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
17042025-01-14T22:31:19.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 879.962607ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
17052025-01-14T22:31:19.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 900.004027ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
17062025-01-14T22:31:19.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 727.296785ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
17072025-01-14T22:31:19.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d") failed: Property not found. retry in 1.419865352s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
17082025-01-14T22:31:19.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 683.433634ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
17092025-01-14T22:31:19.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19") failed: Property not found. retry in 1.038592433s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
17102025-01-14T22:31:19.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 1.388253307s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
17112025-01-14T22:31:19.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 764.595086ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
17122025-01-14T22:31:19.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a") failed: Property not found. retry in 1.009324439s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a
17132025-01-14T22:31:19.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 1.130254077s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
17142025-01-14T22:31:19.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9") failed: Property not found. retry in 1.290437857s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
17152025-01-14T22:31:19.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6") failed: Property not found. retry in 887.829786ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
17162025-01-14T22:31:19.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 599.905055ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
17172025-01-14T22:31:20.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 1.167401572s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
17182025-01-14T22:31:20.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3") failed: Property not found. retry in 826.812049ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3
17192025-01-14T22:31:20.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 555.525486ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
17202025-01-14T22:31:20.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 787.85689ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
17212025-01-14T22:31:20.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 625.9806ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
17222025-01-14T22:31:20.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef") failed: Property not found. retry in 786.124296ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef
17232025-01-14T22:31:20.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 1.028674074s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
17242025-01-14T22:31:20.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 989.802882ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
17252025-01-14T22:31:20.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a") failed: Property not found. retry in 1.061983785s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
17262025-01-14T22:31:20.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 672.542401ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
17272025-01-14T22:31:20.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 869.771112ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
17282025-01-14T22:31:20.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda") failed: Property not found. retry in 962.718705ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda
17292025-01-14T22:31:20.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 1.409224352s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
17302025-01-14T22:31:20.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19") failed: Property not found. retry in 926.554956ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
17312025-01-14T22:31:20.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6") failed: Property not found. retry in 906.075856ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
17322025-01-14T22:31:20.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a") failed: Property not found. retry in 1.218678476s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a
17332025-01-14T22:31:20.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3") failed: Property not found. retry in 1.404060334s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3
17342025-01-14T22:31:20.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 931.698499ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
17352025-01-14T22:31:20.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d") failed: Property not found. retry in 1.010278334s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
17362025-01-14T22:31:20.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 1.18226413s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
17372025-01-14T22:31:21.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 1.489265734s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
17382025-01-14T22:31:21.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 1.047434182s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
17392025-01-14T22:31:21.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef") failed: Property not found. retry in 575.151323ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef
17402025-01-14T22:31:21.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9") failed: Property not found. retry in 909.851484ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
17412025-01-14T22:31:21.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 949.50222ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
17422025-01-14T22:31:21.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 667.025705ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
17432025-01-14T22:31:21.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 1.114236219s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
17442025-01-14T22:31:21.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 681.249847ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
17452025-01-14T22:31:21.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 1.297208628s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
17462025-01-14T22:31:21.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a") failed: Property not found. retry in 589.861942ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
17472025-01-14T22:31:21.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda") failed: Property not found. retry in 550.217008ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda
17482025-01-14T22:31:21.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19") failed: Property not found. retry in 791.685004ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
17492025-01-14T22:31:21.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6") failed: Property not found. retry in 1.17657618s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
17502025-01-14T22:31:21.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef") failed: Property not found. retry in 1.366129405s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef
17512025-01-14T22:31:21.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 553.788087ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
17522025-01-14T22:31:21.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 1.412182572s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
17532025-01-14T22:31:21.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d") failed: Property not found. retry in 925.638176ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
17542025-01-14T22:31:22.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9") failed: Property not found. retry in 1.444112562s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
17552025-01-14T22:31:22.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a") failed: Property not found. retry in 1.446742629s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a
17562025-01-14T22:31:22.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 520.978826ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
17572025-01-14T22:31:22.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 695.366139ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
17582025-01-14T22:31:22.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a") failed: Property not found. retry in 841.996113ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
17592025-01-14T22:31:22.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 880.802165ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
17602025-01-14T22:31:22.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 998.688247ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
17612025-01-14T22:31:22.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 756.084782ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
17622025-01-14T22:31:22.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda") failed: Property not found. retry in 1.455490897s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda
17632025-01-14T22:31:22.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3") failed: Property not found. retry in 1.44592396s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3
17642025-01-14T22:31:22.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19") failed: Property not found. retry in 1.315280832s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
17652025-01-14T22:31:22.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 736.285751ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
17662025-01-14T22:31:22.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 921.579633ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
17672025-01-14T22:31:22.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 1.0930094s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
17682025-01-14T22:31:22.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 566.71517ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
17692025-01-14T22:31:22.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 776.821896ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
17702025-01-14T22:31:22.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 1.162055694s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
17712025-01-14T22:31:22.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6") failed: Property not found. retry in 1.057570394s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
17722025-01-14T22:31:22.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d") failed: Property not found. retry in 1.170148359s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
17732025-01-14T22:31:22.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 1.362099171s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
17742025-01-14T22:31:22.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a") failed: Property not found. retry in 613.446271ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
17752025-01-14T22:31:23.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 1.390330498s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
17762025-01-14T22:31:23.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef") failed: Property not found. retry in 732.414827ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef
17772025-01-14T22:31:23.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 581.630998ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
17782025-01-14T22:31:23.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 562.669334ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
17792025-01-14T22:31:23.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 606.697442ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
17802025-01-14T22:31:23.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 1.389847851s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
17812025-01-14T22:31:23.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 1.346298129s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
17822025-01-14T22:31:23.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9") failed: Property not found. retry in 1.240139252s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
17832025-01-14T22:31:23.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a") failed: Property not found. retry in 827.24475ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a
17842025-01-14T22:31:23.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 521.866359ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
17852025-01-14T22:31:23.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 683.149511ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
17862025-01-14T22:31:23.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda") failed: Property not found. retry in 502.057782ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda
17872025-01-14T22:31:23.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19") failed: Property not found. retry in 1.406171537s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
17882025-01-14T22:31:23.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 559.721022ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
17892025-01-14T22:31:23.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 1.271813225s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
17902025-01-14T22:31:23.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3") failed: Property not found. retry in 814.432238ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3
17912025-01-14T22:31:23.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 1.071256983s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
17922025-01-14T22:31:23.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef") failed: Property not found. retry in 727.292759ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef
17932025-01-14T22:31:23.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6") failed: Property not found. retry in 719.21621ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
17942025-01-14T22:31:24.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 1.254245909s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
17952025-01-14T22:31:24.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d") failed: Property not found. retry in 936.570725ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
17962025-01-14T22:31:24.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 1.270462622s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
17972025-01-14T22:31:24.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda") failed: Property not found. retry in 957.873544ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda
17982025-01-14T22:31:24.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 1.313992425s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
17992025-01-14T22:31:24.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 931.550712ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
18002025-01-14T22:31:24.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117") failed: Property not found. retry in 951.793517ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
18012025-01-14T22:31:24.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a") failed: Property not found. retry in 1.172432668s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a
18022025-01-14T22:31:24.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 508.69229ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
18032025-01-14T22:31:24.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef") failed: Property not found. retry in 836.583246ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef
18042025-01-14T22:31:24.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3") failed: Property not found. retry in 626.568794ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3
18052025-01-14T22:31:24.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d") failed: Property not found. retry in 1.009011713s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
18062025-01-14T22:31:24.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9") failed: Property not found. retry in 924.011641ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
18072025-01-14T22:31:24.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047") failed: Property not found. retry in 1.418948956s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
18082025-01-14T22:31:24.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 656.559444ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
18092025-01-14T22:31:24.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12") failed: Property not found. retry in 677.278593ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
18102025-01-14T22:31:25.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d") failed: Property not found. retry in 1.080857443s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
18112025-01-14T22:31:25.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d") failed: Property not found. retry in 628.45799ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
18122025-01-14T22:31:25.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda") failed: Property not found. retry in 1.401100301s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda
18132025-01-14T22:31:25.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86") failed: Property not found. retry in 538.864644ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
18142025-01-14T22:31:25.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3") failed: Property not found. retry in 1.110740054s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3
18152025-01-14T22:31:25.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042") failed: Property not found. retry in 1.497976415s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
18162025-01-14T22:31:25.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03") failed: Property not found. retry in 1.191712718s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
18172025-01-14T22:31:25.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a") failed: Property not found. retry in 811.183565ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a
18182025-01-14T22:31:25.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4") failed: Property not found. retry in 1.164070545s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
18192025-01-14T22:31:25.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764") failed: Property not found. retry in 816.365122ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
18202025-01-14T22:31:25.782ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37704
18212025-01-14T22:31:25.790ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1857 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37704 req_id = bc0d7449-c491-4aed-8de6-a35ae9fedb24 response_code = 200 uri = /baseboard
18222025-01-14T22:31:26.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a") failed: Property not found. retry in 619.482947ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a
18232025-01-14T22:31:27.066ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_71b43421-d509-416e-9505-4ed299f6cb19
18242025-01-14T22:31:27.067ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_53e6c282-39fc-4639-b8af-1e3c120b5a86
18252025-01-14T22:31:27.067ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_3e4d0c49-0a7f-48e2-8626-a0a2544a44d6
18262025-01-14T22:31:27.067ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_3203df94-bda8-401f-99df-30e90a5f076d
18272025-01-14T22:31:27.067ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_b0506d4d-8223-4315-9fa0-31e028a676f3
18282025-01-14T22:31:27.067ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_clickhouse_98a3c45a-da7a-4517-8dbd-f5f13329260a
18292025-01-14T22:31:27.067ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_faaf481b-b6d5-471e-8caf-838aade7233a
18302025-01-14T22:31:27.067ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_external_dns_a66dcc60-1225-4e39-ab1a-b70caf5209e9
18312025-01-14T22:31:27.067ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_5ea310f0-55b2-45b2-91e6-61560e920cc4
18322025-01-14T22:31:27.067ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_db349e57-b4e4-49a0-96f1-8edc47a91a12
18332025-01-14T22:31:27.067ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_33b9f277-2724-4fde-9002-469a6a2a2f03
18342025-01-14T22:31:27.067ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_505f69b7-006c-4177-84d9-954cc0c52f8d
18352025-01-14T22:31:27.067ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_oximeter_f007913c-5161-449b-84f0-9bb0a3039117
18362025-01-14T22:31:27.067ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_30e50de8-9abb-4694-9323-eb0bf0dd650d
18372025-01-14T22:31:27.067ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_a5e79091-da12-4135-aa4c-900d05bdaeef
18382025-01-14T22:31:27.067ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_external_dns_696becfd-808e-490f-8687-0b1b89035dda
18392025-01-14T22:31:27.067ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_9a877f4f-9e4e-47af-b776-789d43b9d042
18402025-01-14T22:31:27.067ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_c1c1faca-128a-4fbc-9305-aff02770e047
18412025-01-14T22:31:27.067ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_e1b2ab23-7976-4ea8-a2a7-c53e015d5764
18422025-01-14T22:31:27.069ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18432025-01-14T22:31:27.072ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18442025-01-14T22:31:27.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35532581 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:51853 req_id = 9a3759ea-4f00-4a14-84a7-4331d03a3235 response_code = 204 uri = /omicron-zones
18452025-01-14T22:31:27.095ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
18462025-01-14T22:31:27.288ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
18472025-01-14T22:31:27.290ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:803
18482025-01-14T22:31:27.344ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1017
18492025-01-14T22:31:29.274ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e46a19d5-4ebb-4613-bf07-7717ce8f3a2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18502025-01-14T22:31:29.302ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/652f7dd4-af0c-42f1-b515-fb2bf74375f9) file = sled-agent/src/probe_manager.rs:231 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
18512025-01-14T22:31:29.303ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/652f7dd4-af0c-42f1-b515-fb2bf74375f9) file = sled-agent/src/nexus.rs:527 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
18522025-01-14T22:31:29.369ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e46a19d5-4ebb-4613-bf07-7717ce8f3a2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18532025-01-14T22:31:29.473ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e46a19d5-4ebb-4613-bf07-7717ce8f3a2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18542025-01-14T22:31:29.591ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e46a19d5-4ebb-4613-bf07-7717ce8f3a2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18552025-01-14T22:31:29.695ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e46a19d5-4ebb-4613-bf07-7717ce8f3a2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18562025-01-14T22:31:29.972ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e46a19d5-4ebb-4613-bf07-7717ce8f3a2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18572025-01-14T22:31:30.265ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e46a19d5-4ebb-4613-bf07-7717ce8f3a2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18582025-01-14T22:31:30.311ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/652f7dd4-af0c-42f1-b515-fb2bf74375f9) file = sled-agent/src/probe_manager.rs:231 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
18592025-01-14T22:31:30.449ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e46a19d5-4ebb-4613-bf07-7717ce8f3a2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18602025-01-14T22:31:30.888ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/652f7dd4-af0c-42f1-b515-fb2bf74375f9) file = sled-agent/src/nexus.rs:527 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
18612025-01-14T22:31:30.945ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e46a19d5-4ebb-4613-bf07-7717ce8f3a2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18622025-01-14T22:31:31.195ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e46a19d5-4ebb-4613-bf07-7717ce8f3a2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18632025-01-14T22:31:31.314ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/652f7dd4-af0c-42f1-b515-fb2bf74375f9) file = sled-agent/src/probe_manager.rs:231 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
18642025-01-14T22:31:31.514ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e46a19d5-4ebb-4613-bf07-7717ce8f3a2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18652025-01-14T22:31:31.861ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e46a19d5-4ebb-4613-bf07-7717ce8f3a2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18662025-01-14T22:31:32.316ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/652f7dd4-af0c-42f1-b515-fb2bf74375f9) file = sled-agent/src/probe_manager.rs:231 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
18672025-01-14T22:31:32.545ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e46a19d5-4ebb-4613-bf07-7717ce8f3a2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18682025-01-14T22:31:32.881ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/652f7dd4-af0c-42f1-b515-fb2bf74375f9) file = sled-agent/src/nexus.rs:527 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
18692025-01-14T22:31:33.319ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/652f7dd4-af0c-42f1-b515-fb2bf74375f9) file = sled-agent/src/probe_manager.rs:231 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
18702025-01-14T22:31:33.740ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/e46a19d5-4ebb-4613-bf07-7717ce8f3a2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18712025-01-14T22:31:35.232ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a2a8dee6-b61e-4fe0-8411-2d0fa50a7bf8", "content-length": "173", "date": "Tue, 14 Jan 2025 22:31:35 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"e46a19d5-4ebb-4613-bf07-7717ce8f3a2e\"", request_id: "a2a8dee6-b61e-4fe0-8411-2d0fa50a7bf8" } file = sled-agent/src/rack_setup/service.rs:1079
18722025-01-14T22:31:36.910ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
18732025-01-14T22:31:37.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61817
18742025-01-14T22:31:37.575ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18752025-01-14T22:31:37.575ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18762025-01-14T22:31:37.575ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/omicron-zones.json file = common/src/ledger.rs:177
18772025-01-14T22:31:37.576ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/omicron-zones.json file = common/src/ledger.rs:177
18782025-01-14T22:31:37.589ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18792025-01-14T22:31:37.589ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8
18802025-01-14T22:31:37.615ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18812025-01-14T22:31:37.615ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_17026a0f-546c-4e8b-87e1-2bef866e5f38
18822025-01-14T22:31:37.639ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18832025-01-14T22:31:37.639ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_193d38c2-fbe5-4b1d-95c5-92a256ddffe2
18842025-01-14T22:31:37.660ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18852025-01-14T22:31:37.660ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f72d9943-3b41-40fd-968b-8debb9d0e66b
18862025-01-14T22:31:37.681ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18872025-01-14T22:31:37.681ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ebeecaa7-8727-491c-81b6-8ff8177ba2c6
18882025-01-14T22:31:37.702ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18892025-01-14T22:31:37.702ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_489724fa-785f-4f35-bb0f-34adf6a09482
18902025-01-14T22:31:37.722ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a77abd92-fef1-4271-b3d6-7b70ec3d579b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18912025-01-14T22:31:37.722ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a77abd92-fef1-4271-b3d6-7b70ec3d579b
18922025-01-14T22:31:37.741ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18932025-01-14T22:31:37.741ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59
18942025-01-14T22:31:37.761ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18952025-01-14T22:31:37.761ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_42c887d6-10d1-4b8b-a7bb-82239cc2998c
18962025-01-14T22:31:37.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200675 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61817 req_id = b9035041-35c1-4644-a9bf-6378a54ce8a8 response_code = 200 uri = /inventory
18972025-01-14T22:31:37.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64558
18982025-01-14T22:31:37.804ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 08ab3e6f-8169-4727-9bfd-8dd0f022af2c, kind: Service { id: a66dcc60-1225-4e39-ab1a-b70caf5209e9 }, name: Name("external-dns-a66dcc60-1225-4e39-ab1a-b70caf5209e9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd47cf7f-251c-4290-8688-7e2060f2050c, kind: Service { id: 696becfd-808e-490f-8687-0b1b89035dda }, name: Name("external-dns-696becfd-808e-490f-8687-0b1b89035dda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 187])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0db76917-acaf-4b6b-8dbb-d22b559cd940, kind: Service { id: e1b2ab23-7976-4ea8-a2a7-c53e015d5764 }, name: Name("nexus-e1b2ab23-7976-4ea8-a2a7-c53e015d5764"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 922e49e1-e5c9-4471-b22f-5e46cae983ea, kind: Service { id: 3203df94-bda8-401f-99df-30e90a5f076d }, name: Name("nexus-3203df94-bda8-401f-99df-30e90a5f076d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9ca98b6d-c3b4-4bfe-a1f8-0d99a0a5ce6f, kind: Service { id: b0506d4d-8223-4315-9fa0-31e028a676f3 }, name: Name("nexus-b0506d4d-8223-4315-9fa0-31e028a676f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18992025-01-14T22:31:37.805ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19002025-01-14T22:31:37.805ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19012025-01-14T22:31:37.805ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19022025-01-14T22:31:37.805ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19032025-01-14T22:31:37.805ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19042025-01-14T22:31:37.805ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19052025-01-14T22:31:37.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1595 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64558 req_id = cc78d973-7945-4a49-9aaf-33b0d65bd428 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19062025-01-14T22:31:37.806ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1089
19072025-01-14T22:31:37.810ZINFOSledAgent (RSS): Writing ledger to /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
19082025-01-14T22:31:37.815ZINFOSledAgent (RSS): Writing ledger to /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
19092025-01-14T22:31:38.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45035
19102025-01-14T22:31:38.160ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19112025-01-14T22:31:38.160ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19122025-01-14T22:31:38.160ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/omicron-zones.json file = common/src/ledger.rs:177
19132025-01-14T22:31:38.160ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/omicron-zones.json file = common/src/ledger.rs:177
19142025-01-14T22:31:38.172ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19152025-01-14T22:31:38.172ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8
19162025-01-14T22:31:38.195ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19172025-01-14T22:31:38.195ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_17026a0f-546c-4e8b-87e1-2bef866e5f38
19182025-01-14T22:31:38.220ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19192025-01-14T22:31:38.220ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_193d38c2-fbe5-4b1d-95c5-92a256ddffe2
19202025-01-14T22:31:38.242ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19212025-01-14T22:31:38.242ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f72d9943-3b41-40fd-968b-8debb9d0e66b
19222025-01-14T22:31:38.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41344
19232025-01-14T22:31:38.246ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 08ab3e6f-8169-4727-9bfd-8dd0f022af2c, kind: Service { id: a66dcc60-1225-4e39-ab1a-b70caf5209e9 }, name: Name("external-dns-a66dcc60-1225-4e39-ab1a-b70caf5209e9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd47cf7f-251c-4290-8688-7e2060f2050c, kind: Service { id: 696becfd-808e-490f-8687-0b1b89035dda }, name: Name("external-dns-696becfd-808e-490f-8687-0b1b89035dda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 187])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0db76917-acaf-4b6b-8dbb-d22b559cd940, kind: Service { id: e1b2ab23-7976-4ea8-a2a7-c53e015d5764 }, name: Name("nexus-e1b2ab23-7976-4ea8-a2a7-c53e015d5764"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 922e49e1-e5c9-4471-b22f-5e46cae983ea, kind: Service { id: 3203df94-bda8-401f-99df-30e90a5f076d }, name: Name("nexus-3203df94-bda8-401f-99df-30e90a5f076d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9ca98b6d-c3b4-4bfe-a1f8-0d99a0a5ce6f, kind: Service { id: b0506d4d-8223-4315-9fa0-31e028a676f3 }, name: Name("nexus-b0506d4d-8223-4315-9fa0-31e028a676f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19242025-01-14T22:31:38.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19252025-01-14T22:31:38.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19262025-01-14T22:31:38.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19272025-01-14T22:31:38.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19282025-01-14T22:31:38.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19292025-01-14T22:31:38.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19302025-01-14T22:31:38.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 621 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41344 req_id = 63f7e76b-e50e-4d8b-9707-52970559b83e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19312025-01-14T22:31:38.264ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19322025-01-14T22:31:38.264ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ebeecaa7-8727-491c-81b6-8ff8177ba2c6
19332025-01-14T22:31:38.286ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19342025-01-14T22:31:38.286ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_489724fa-785f-4f35-bb0f-34adf6a09482
19352025-01-14T22:31:38.307ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a77abd92-fef1-4271-b3d6-7b70ec3d579b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19362025-01-14T22:31:38.307ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a77abd92-fef1-4271-b3d6-7b70ec3d579b
19372025-01-14T22:31:38.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52912
19382025-01-14T22:31:38.323ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 08ab3e6f-8169-4727-9bfd-8dd0f022af2c, kind: Service { id: a66dcc60-1225-4e39-ab1a-b70caf5209e9 }, name: Name("external-dns-a66dcc60-1225-4e39-ab1a-b70caf5209e9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd47cf7f-251c-4290-8688-7e2060f2050c, kind: Service { id: 696becfd-808e-490f-8687-0b1b89035dda }, name: Name("external-dns-696becfd-808e-490f-8687-0b1b89035dda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 187])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0db76917-acaf-4b6b-8dbb-d22b559cd940, kind: Service { id: e1b2ab23-7976-4ea8-a2a7-c53e015d5764 }, name: Name("nexus-e1b2ab23-7976-4ea8-a2a7-c53e015d5764"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 922e49e1-e5c9-4471-b22f-5e46cae983ea, kind: Service { id: 3203df94-bda8-401f-99df-30e90a5f076d }, name: Name("nexus-3203df94-bda8-401f-99df-30e90a5f076d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9ca98b6d-c3b4-4bfe-a1f8-0d99a0a5ce6f, kind: Service { id: b0506d4d-8223-4315-9fa0-31e028a676f3 }, name: Name("nexus-b0506d4d-8223-4315-9fa0-31e028a676f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19392025-01-14T22:31:38.323ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19402025-01-14T22:31:38.323ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19412025-01-14T22:31:38.323ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19422025-01-14T22:31:38.324ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19432025-01-14T22:31:38.324ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19442025-01-14T22:31:38.324ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19452025-01-14T22:31:38.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1053 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52912 req_id = 7e277bc2-0ba0-4325-b037-43d5a39c1d25 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19462025-01-14T22:31:38.325ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19472025-01-14T22:31:38.325ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59
19482025-01-14T22:31:38.345ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19492025-01-14T22:31:38.345ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_42c887d6-10d1-4b8b-a7bb-82239cc2998c
19502025-01-14T22:31:38.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197908 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45035 req_id = 2ce393bb-fbbd-47ce-868f-8bd329503115 response_code = 200 uri = /inventory
19512025-01-14T22:31:38.608ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46563
19522025-01-14T22:31:38.609ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 08ab3e6f-8169-4727-9bfd-8dd0f022af2c, kind: Service { id: a66dcc60-1225-4e39-ab1a-b70caf5209e9 }, name: Name("external-dns-a66dcc60-1225-4e39-ab1a-b70caf5209e9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd47cf7f-251c-4290-8688-7e2060f2050c, kind: Service { id: 696becfd-808e-490f-8687-0b1b89035dda }, name: Name("external-dns-696becfd-808e-490f-8687-0b1b89035dda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 187])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0db76917-acaf-4b6b-8dbb-d22b559cd940, kind: Service { id: e1b2ab23-7976-4ea8-a2a7-c53e015d5764 }, name: Name("nexus-e1b2ab23-7976-4ea8-a2a7-c53e015d5764"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 922e49e1-e5c9-4471-b22f-5e46cae983ea, kind: Service { id: 3203df94-bda8-401f-99df-30e90a5f076d }, name: Name("nexus-3203df94-bda8-401f-99df-30e90a5f076d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9ca98b6d-c3b4-4bfe-a1f8-0d99a0a5ce6f, kind: Service { id: b0506d4d-8223-4315-9fa0-31e028a676f3 }, name: Name("nexus-b0506d4d-8223-4315-9fa0-31e028a676f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19532025-01-14T22:31:38.609ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19542025-01-14T22:31:38.609ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19552025-01-14T22:31:38.609ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19562025-01-14T22:31:38.609ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19572025-01-14T22:31:38.609ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19582025-01-14T22:31:38.609ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19592025-01-14T22:31:38.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 339 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46563 req_id = 40e0029b-264a-4d5a-bcad-5f91236e6a1d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19602025-01-14T22:31:45.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50532
19612025-01-14T22:31:45.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 463 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50532 req_id = 3f59f9a1-a243-495f-a937-549943499d29 response_code = 200 uri = /vpc-routes
19622025-01-14T22:31:45.764ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
19632025-01-14T22:31:45.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 589 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50532 req_id = 4313ffc0-a1cf-47a5-b1e8-0e77f89464ae response_code = 204 uri = /eip-gateways
19642025-01-14T22:31:45.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50532 req_id = 0c64ff68-d8b8-4c1d-b995-b45dcd3923c5 response_code = 204 uri = /vpc-routes
19652025-01-14T22:31:55.824ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44634
19662025-01-14T22:31:55.824ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44634 req_id = 1e691b96-be92-4f8d-9997-64c99693cc91 response_code = 200 uri = /baseboard
19672025-01-14T22:32:06.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60039
19682025-01-14T22:32:06.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60039 req_id = 0ec28ab1-bc2a-4d8b-972a-212d59b60c00 response_code = 200 uri = /vpc-routes
19692025-01-14T22:32:06.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34118
19702025-01-14T22:32:06.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34118 req_id = ba72b9e3-8dd5-4e6a-a100-fb92754d45f3 response_code = 200 uri = /vpc-routes
19712025-01-14T22:32:06.177ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
19722025-01-14T22:32:06.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60039 req_id = af0580ce-8e96-4b5c-b548-13e792ae4280 response_code = 204 uri = /eip-gateways
19732025-01-14T22:32:06.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33081
19742025-01-14T22:32:06.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 486 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33081 req_id = 4754a45a-68cb-4523-8cf0-57003524e470 response_code = 200 uri = /v2p
19752025-01-14T22:32:06.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60039 req_id = f9829202-a943-40a4-8bcb-f31c775845b9 response_code = 204 uri = /vpc-routes
19762025-01-14T22:32:06.199ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
19772025-01-14T22:32:06.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34118 req_id = 4d4bb56d-ffc8-4993-8c6d-86f6734e4b7a response_code = 204 uri = /eip-gateways
19782025-01-14T22:32:06.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34118 req_id = fb6197b9-c387-4f65-b95a-ee6c70e4e4fa response_code = 204 uri = /vpc-routes
19792025-01-14T22:32:06.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55528
19802025-01-14T22:32:06.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55528 req_id = bca3e689-26a1-43aa-b09d-952c7e0c096b response_code = 200 uri = /vpc-routes
19812025-01-14T22:32:06.375ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
19822025-01-14T22:32:06.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55528 req_id = 9f1cf7ea-6c39-4d79-bb57-7a94a868bb13 response_code = 204 uri = /eip-gateways
19832025-01-14T22:32:06.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47736
19842025-01-14T22:32:06.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47736 req_id = 14f037ee-10bf-4b88-a195-d810ddacaac8 response_code = 200 uri = /v2p
19852025-01-14T22:32:06.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55528 req_id = 0ba27efa-7b4e-4e37-9dbe-a0110c03a869 response_code = 204 uri = /vpc-routes
19862025-01-14T22:32:06.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52989
19872025-01-14T22:32:06.386ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19882025-01-14T22:32:06.467ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19892025-01-14T22:32:06.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144498 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52989 req_id = a1360926-9495-4d42-afce-1280c84fe2ab response_code = 204 uri = /switch-ports
19902025-01-14T22:32:06.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46509
19912025-01-14T22:32:06.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37447
19922025-01-14T22:32:06.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46509 req_id = 8610789c-666d-4207-a59b-597f3281194f response_code = 200 uri = /v2p
19932025-01-14T22:32:06.532ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19942025-01-14T22:32:06.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6364 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52989 req_id = 7bbcff5f-faf8-484d-8309-87425f894179 response_code = 200 uri = /network-bootstore-config
19952025-01-14T22:32:06.573ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19962025-01-14T22:32:06.594ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
19972025-01-14T22:32:06.595ZINFOSledAgent (bootstore): Writing ledger to /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19982025-01-14T22:32:06.597ZINFOSledAgent (bootstore): Writing ledger to /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19992025-01-14T22:32:06.597ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
20002025-01-14T22:32:06.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4478 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52989 req_id = 3b7f356d-b2e6-4c5e-9af2-aa796c43eabd response_code = 204 uri = /network-bootstore-config
20012025-01-14T22:32:06.628ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62933
20022025-01-14T22:32:06.637ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20032025-01-14T22:32:06.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106823 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37447 req_id = 701f2c60-9220-4fa0-a778-7a8a90efd957 response_code = 204 uri = /switch-ports
20042025-01-14T22:32:06.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 992 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37447 req_id = 16d22b8d-8ff0-490a-a914-44a3058f22ce response_code = 200 uri = /network-bootstore-config
20052025-01-14T22:32:06.674ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20062025-01-14T22:32:06.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96801 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62933 req_id = 3c08ad6b-ad13-474f-9039-4517d5df9d7b response_code = 204 uri = /switch-ports
20072025-01-14T22:32:06.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62933 req_id = 13276070-cda1-446f-87fd-bb83170c0720 response_code = 200 uri = /network-bootstore-config
20082025-01-14T22:32:25.869ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57337
20092025-01-14T22:32:25.869ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57337 req_id = 0a367e20-6197-40da-a783-2bb608210613 response_code = 200 uri = /baseboard
20102025-01-14T22:32:36.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58040
20112025-01-14T22:32:36.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58040 req_id = cbdea076-5bda-4b52-bcd2-77485ace728f response_code = 200 uri = /vpc-routes
20122025-01-14T22:32:36.120ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
20132025-01-14T22:32:36.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58040 req_id = b659a6c8-583a-4297-a93f-654ff7ef5d86 response_code = 204 uri = /eip-gateways
20142025-01-14T22:32:36.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58040 req_id = ebb0163f-cef7-42da-8e53-e661ddb93715 response_code = 204 uri = /vpc-routes
20152025-01-14T22:32:36.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63187
20162025-01-14T22:32:36.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63187 req_id = 29cfc5de-d1ae-404d-9745-e4bed28ea51d response_code = 200 uri = /vpc-routes
20172025-01-14T22:32:36.315ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
20182025-01-14T22:32:36.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63187 req_id = 94d3315b-2242-4d2c-9b5d-0b56e7a7bea2 response_code = 204 uri = /eip-gateways
20192025-01-14T22:32:36.338ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61271
20202025-01-14T22:32:36.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61271 req_id = 4a20214e-dafe-48ab-8882-103e90b19240 response_code = 200 uri = /v2p
20212025-01-14T22:32:36.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34730
20222025-01-14T22:32:36.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34730 req_id = 376a7c73-7d14-48cd-9ebc-1b535e378c58 response_code = 200 uri = /vpc-routes
20232025-01-14T22:32:36.466ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
20242025-01-14T22:32:36.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34730 req_id = c34c034f-7019-48d6-a844-741ad98b795d response_code = 204 uri = /eip-gateways
20252025-01-14T22:32:36.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41164
20262025-01-14T22:32:36.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41164 req_id = bfd99ac5-f8a0-4362-b901-711d97b03067 response_code = 200 uri = /v2p
20272025-01-14T22:32:36.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63187 req_id = f472b2f6-4eea-466c-8a07-c182de889fe0 response_code = 204 uri = /vpc-routes
20282025-01-14T22:32:36.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34730 req_id = 59b6026c-669f-45df-9c31-670957f197e6 response_code = 204 uri = /vpc-routes
20292025-01-14T22:32:36.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58386
20302025-01-14T22:32:36.585ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20312025-01-14T22:32:36.627ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20322025-01-14T22:32:36.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99984 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58386 req_id = c6d65543-6340-41b1-b842-234c64467aef response_code = 204 uri = /switch-ports
20332025-01-14T22:32:36.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57033
20342025-01-14T22:32:36.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58386 req_id = 94aa6413-504d-4901-92ec-83596a10de13 response_code = 200 uri = /network-bootstore-config
20352025-01-14T22:32:36.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57033 req_id = 7451f3f5-cb2a-4075-a87e-b9901f7d6eee response_code = 200 uri = /v2p
20362025-01-14T22:32:36.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62815
20372025-01-14T22:32:36.741ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20382025-01-14T22:32:36.776ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20392025-01-14T22:32:36.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86924 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62815 req_id = f8d4e950-2945-40fe-83cb-d982c7603b34 response_code = 204 uri = /switch-ports
20402025-01-14T22:32:36.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64318
20412025-01-14T22:32:36.828ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20422025-01-14T22:32:36.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3338 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62815 req_id = 244dad71-0af9-4751-a513-0867dafcceb3 response_code = 200 uri = /network-bootstore-config
20432025-01-14T22:32:36.862ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20442025-01-14T22:32:36.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85084 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64318 req_id = cbceda80-3a68-4c01-9594-8910f88f64b8 response_code = 204 uri = /switch-ports
20452025-01-14T22:32:36.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64318 req_id = eb9b2df6-2b6b-417f-b1b7-2dfaf5d350fe response_code = 200 uri = /network-bootstore-config
20462025-01-14T22:32:49.138ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20472025-01-14T22:32:55.904ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37478
20482025-01-14T22:32:55.904ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37478 req_id = 937b424a-866d-4d10-8a25-da642ad955e2 response_code = 200 uri = /baseboard
20492025-01-14T22:33:04.006ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:50816 remote_addr = [fd00:1122:3344:101::d]:55313 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
20502025-01-14T22:33:04.037ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31381 local_addr = [fd00:1122:3344:101::1]:50816 method = GET remote_addr = [fd00:1122:3344:101::d]:55313 req_id = 4af1ab3f-aa15-4af7-a715-e0b42eb4211d response_code = 200 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 uri = /652f7dd4-af0c-42f1-b515-fb2bf74375f9
20512025-01-14T22:33:06.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64707
20522025-01-14T22:33:06.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64707 req_id = fc97ec23-d306-44fb-8577-8309e838840b response_code = 200 uri = /vpc-routes
20532025-01-14T22:33:06.072ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
20542025-01-14T22:33:06.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64707 req_id = 40655296-bc8f-44f6-b557-2b91991052b1 response_code = 204 uri = /eip-gateways
20552025-01-14T22:33:06.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64707 req_id = a78ef033-a21f-4871-b315-01c5610a0b6c response_code = 204 uri = /vpc-routes
20562025-01-14T22:33:06.131ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57341
20572025-01-14T22:33:06.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57341 req_id = 3d4cdc2a-a6da-4098-8029-446b4f839197 response_code = 200 uri = /vpc-routes
20582025-01-14T22:33:06.196ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
20592025-01-14T22:33:06.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57341 req_id = 6029c64c-a177-4b14-9009-eb86c85be38c response_code = 204 uri = /eip-gateways
20602025-01-14T22:33:06.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57341 req_id = 39bf59bb-ebd3-4072-9c78-79a755929838 response_code = 204 uri = /vpc-routes
20612025-01-14T22:33:06.220ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37164
20622025-01-14T22:33:06.220ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20632025-01-14T22:33:06.269ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20642025-01-14T22:33:06.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122041 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37164 req_id = 7a3784f0-86fb-423a-9d89-b829e1e550e0 response_code = 204 uri = /switch-ports
20652025-01-14T22:33:06.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47565
20662025-01-14T22:33:06.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62187
20672025-01-14T22:33:06.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58509
20682025-01-14T22:33:06.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37164 req_id = dac227a0-34f1-4fac-92cc-e2c960231906 response_code = 200 uri = /network-bootstore-config
20692025-01-14T22:33:06.343ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20702025-01-14T22:33:06.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7296 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47565 req_id = 51251f36-8d21-486a-8da4-f6e86d971123 response_code = 200 uri = /v2p
20712025-01-14T22:33:06.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58509 req_id = 72cd007c-f4de-4faa-9f5a-378898e6cc7c response_code = 200 uri = /v2p
20722025-01-14T22:33:06.366ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34860
20732025-01-14T22:33:06.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34860 req_id = 145aff77-9e17-4ace-b839-5a35d95a748e response_code = 200 uri = /vpc-routes
20742025-01-14T22:33:06.392ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20752025-01-14T22:33:06.413ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
20762025-01-14T22:33:06.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34860 req_id = 11c4822b-dc0e-476a-a4ed-8da32f10f09d response_code = 204 uri = /eip-gateways
20772025-01-14T22:33:06.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33444
20782025-01-14T22:33:06.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33444 req_id = dde65311-a504-49f7-94a0-941d8533e22f response_code = 200 uri = /v2p
20792025-01-14T22:33:06.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 597 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34860 req_id = e5eb9aa8-c2a8-44d5-b62e-f7031a5c0629 response_code = 204 uri = /vpc-routes
20802025-01-14T22:33:06.455ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45612
20812025-01-14T22:33:06.456ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20822025-01-14T22:33:06.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113540 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62187 req_id = c326b838-8f75-4f90-a3df-9e9682f436f6 response_code = 204 uri = /switch-ports
20832025-01-14T22:33:06.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 758 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62187 req_id = 61e7c255-d993-4373-be60-fa872ae8bc16 response_code = 200 uri = /network-bootstore-config
20842025-01-14T22:33:06.495ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20852025-01-14T22:33:06.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93770 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45612 req_id = 2d6fa55f-a7ba-48ca-819f-44805a5afe28 response_code = 204 uri = /switch-ports
20862025-01-14T22:33:06.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45612 req_id = 9067b7ab-0fc2-4f56-89cc-e24d0b77e782 response_code = 200 uri = /network-bootstore-config
20872025-01-14T22:33:25.941ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44209
20882025-01-14T22:33:25.941ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44209 req_id = a78012ae-b2e1-4840-9941-9d7959151bc6 response_code = 200 uri = /baseboard
20892025-01-14T22:33:34.012ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5856 local_addr = [fd00:1122:3344:101::1]:50816 method = GET remote_addr = [fd00:1122:3344:101::d]:55313 req_id = 789b9107-520d-4deb-a7d7-e31719d94a3b response_code = 200 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 uri = /652f7dd4-af0c-42f1-b515-fb2bf74375f9
20902025-01-14T22:33:36.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61373
20912025-01-14T22:33:36.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61373 req_id = d6da4c73-76ee-4a78-9db6-5d182aeda8e9 response_code = 200 uri = /vpc-routes
20922025-01-14T22:33:36.293ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
20932025-01-14T22:33:36.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61373 req_id = acec5971-1de9-4a90-a795-9178cd9f9428 response_code = 204 uri = /eip-gateways
20942025-01-14T22:33:36.317ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64673
20952025-01-14T22:33:36.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64673 req_id = b95b438f-d0b0-4055-b62c-47243a8b380d response_code = 200 uri = /vpc-routes
20962025-01-14T22:33:36.373ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
20972025-01-14T22:33:36.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64673 req_id = 219dca61-9bd0-43eb-83e6-f6b9de284b9d response_code = 204 uri = /eip-gateways
20982025-01-14T22:33:36.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64673 req_id = 1990168c-6719-4dd0-82ab-fcc4423d67aa response_code = 204 uri = /vpc-routes
20992025-01-14T22:33:36.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52410
21002025-01-14T22:33:36.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52410 req_id = e47377ae-06e7-4a56-8c39-f65fb0a69cce response_code = 200 uri = /v2p
21012025-01-14T22:33:36.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61373 req_id = 57880cc6-a421-4f42-ad5d-b82d20f0545f response_code = 204 uri = /vpc-routes
21022025-01-14T22:33:36.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61049
21032025-01-14T22:33:36.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61049 req_id = 1e8d21de-ecc8-43a3-9006-c1f084bb5e2e response_code = 200 uri = /v2p
21042025-01-14T22:33:36.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34522
21052025-01-14T22:33:36.473ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21062025-01-14T22:33:36.508ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21072025-01-14T22:33:36.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94257 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34522 req_id = bb0282c8-d550-4ad3-91d8-13dac8e86896 response_code = 204 uri = /switch-ports
21082025-01-14T22:33:36.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40409
21092025-01-14T22:33:36.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40409 req_id = 63a5f60f-b4cb-40bd-8bca-77a3af482d1c response_code = 200 uri = /vpc-routes
21102025-01-14T22:33:36.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 370 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34522 req_id = 539bc4dd-df98-4b20-b554-8739f11e5032 response_code = 200 uri = /network-bootstore-config
21112025-01-14T22:33:36.611ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38710
21122025-01-14T22:33:36.611ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21132025-01-14T22:33:36.650ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21142025-01-14T22:33:36.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95490 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38710 req_id = 6abef65c-7193-4f3e-9dc1-41f75072f9f7 response_code = 204 uri = /switch-ports
21152025-01-14T22:33:36.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41050
21162025-01-14T22:33:36.707ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
21172025-01-14T22:33:36.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42761
21182025-01-14T22:33:36.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40409 req_id = 8f9efade-2075-4783-ac0a-ae5212a39b16 response_code = 204 uri = /eip-gateways
21192025-01-14T22:33:36.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38710 req_id = 7d4989b3-a76c-4734-a302-48be0284a2a6 response_code = 200 uri = /network-bootstore-config
21202025-01-14T22:33:36.707ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21212025-01-14T22:33:36.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41050 req_id = 350dc148-5337-4edc-b2b0-a221b56875c6 response_code = 200 uri = /v2p
21222025-01-14T22:33:36.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 372 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40409 req_id = 7cdf88d9-a6a4-49fa-918e-e519181268da response_code = 204 uri = /vpc-routes
21232025-01-14T22:33:36.746ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21242025-01-14T22:33:36.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96932 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42761 req_id = 3544c0f7-fc8a-461b-83fc-c02028b9ad08 response_code = 204 uri = /switch-ports
21252025-01-14T22:33:36.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42761 req_id = e05e34d1-a12b-486b-bebd-d1737125eb0e response_code = 200 uri = /network-bootstore-config
21262025-01-14T22:33:55.975ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55689
21272025-01-14T22:33:55.975ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55689 req_id = e1651e40-1300-4189-9b54-625976c0d338 response_code = 200 uri = /baseboard
21282025-01-14T22:34:04.012ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5803 local_addr = [fd00:1122:3344:101::1]:50816 method = GET remote_addr = [fd00:1122:3344:101::d]:55313 req_id = 9ec69091-ff45-45a1-8899-89b75eb2a32a response_code = 200 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 uri = /652f7dd4-af0c-42f1-b515-fb2bf74375f9
21292025-01-14T22:34:06.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33437
21302025-01-14T22:34:06.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33437 req_id = 297b56b7-9553-44f5-ba2b-c5854575c737 response_code = 200 uri = /vpc-routes
21312025-01-14T22:34:06.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42108
21322025-01-14T22:34:06.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42108 req_id = d8db8d6c-8549-46d5-ba17-e0e33ccc51db response_code = 200 uri = /vpc-routes
21332025-01-14T22:34:06.162ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
21342025-01-14T22:34:06.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33437 req_id = 416c4413-df43-4b8f-9483-bf4b273045c4 response_code = 204 uri = /eip-gateways
21352025-01-14T22:34:06.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33437 req_id = 4486407c-f8ab-4ac5-a89b-c400ab0d6bab response_code = 204 uri = /vpc-routes
21362025-01-14T22:34:06.184ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
21372025-01-14T22:34:06.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42108 req_id = f88e099b-efec-45d8-b168-40bdc3142e6f response_code = 204 uri = /eip-gateways
21382025-01-14T22:34:06.207ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53443
21392025-01-14T22:34:06.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53443 req_id = b752bc7f-501d-494e-9c2d-bf68803aa170 response_code = 200 uri = /v2p
21402025-01-14T22:34:06.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64594
21412025-01-14T22:34:06.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64594 req_id = 342a5100-dafc-4d70-9d49-a16c1ee2e2df response_code = 200 uri = /v2p
21422025-01-14T22:34:06.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62844
21432025-01-14T22:34:06.210ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21442025-01-14T22:34:06.256ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21452025-01-14T22:34:06.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111891 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62844 req_id = 89dce560-2bb8-486b-bc1d-417fdc3d8df5 response_code = 204 uri = /switch-ports
21462025-01-14T22:34:06.323ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44368
21472025-01-14T22:34:06.323ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43069
21482025-01-14T22:34:06.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44368 req_id = 7ac2e188-ab59-4063-a089-607babf116fa response_code = 200 uri = /vpc-routes
21492025-01-14T22:34:06.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 345 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62844 req_id = bcec0fc4-0f48-4c40-ba38-6dbbd10576a4 response_code = 200 uri = /network-bootstore-config
21502025-01-14T22:34:06.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 595 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42108 req_id = f194c18d-509c-4c64-8728-206bdeaaab07 response_code = 204 uri = /vpc-routes
21512025-01-14T22:34:06.324ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21522025-01-14T22:34:06.367ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21532025-01-14T22:34:06.376ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
21542025-01-14T22:34:06.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44368 req_id = 6211ad27-b7da-423e-bd76-85c45f70f81a response_code = 204 uri = /eip-gateways
21552025-01-14T22:34:06.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 702 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44368 req_id = 6b203330-b536-48a6-85ca-bc41166e9336 response_code = 204 uri = /vpc-routes
21562025-01-14T22:34:06.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37749
21572025-01-14T22:34:06.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37524
21582025-01-14T22:34:06.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37524 req_id = 1e931e01-f239-478c-af46-e49e0180dd87 response_code = 200 uri = /v2p
21592025-01-14T22:34:06.432ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21602025-01-14T22:34:06.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109136 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43069 req_id = 07962d8a-10f3-43eb-92b7-bd09819b7781 response_code = 204 uri = /switch-ports
21612025-01-14T22:34:06.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 751 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43069 req_id = cb4c1723-30e5-4448-962b-1c5e2d41eeaf response_code = 200 uri = /network-bootstore-config
21622025-01-14T22:34:06.471ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21632025-01-14T22:34:06.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139877 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37749 req_id = 458c25c9-04a9-4803-957d-c0b2467d0e28 response_code = 204 uri = /switch-ports
21642025-01-14T22:34:06.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37749 req_id = 0ebc117b-228a-4878-a47a-fb482efeaf5e response_code = 200 uri = /network-bootstore-config
21652025-01-14T22:34:26.011ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58955
21662025-01-14T22:34:26.011ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58955 req_id = 84375d78-e7bb-450a-84d6-a8a95ee8c1a8 response_code = 200 uri = /baseboard
21672025-01-14T22:34:34.015ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7844 local_addr = [fd00:1122:3344:101::1]:50816 method = GET remote_addr = [fd00:1122:3344:101::d]:55313 req_id = aedebbd1-c207-49a8-9fd1-81b549e8f555 response_code = 200 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 uri = /652f7dd4-af0c-42f1-b515-fb2bf74375f9
21682025-01-14T22:34:36.250ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64444
21692025-01-14T22:34:36.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64444 req_id = e55fadd3-995b-46c5-baeb-e7c529d979a3 response_code = 200 uri = /vpc-routes
21702025-01-14T22:34:36.314ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
21712025-01-14T22:34:36.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64444 req_id = 47beb23e-853c-4679-8a0a-642ea816c841 response_code = 204 uri = /eip-gateways
21722025-01-14T22:34:36.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64444 req_id = e8e9cb72-0629-44a9-8abb-bb355a2daa0d response_code = 204 uri = /vpc-routes
21732025-01-14T22:34:36.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60866
21742025-01-14T22:34:36.363ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21752025-01-14T22:34:36.404ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21762025-01-14T22:34:36.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114318 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60866 req_id = 34143210-d8aa-454f-a705-486b16433aed response_code = 204 uri = /switch-ports
21772025-01-14T22:34:36.478ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49112
21782025-01-14T22:34:36.478ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46863
21792025-01-14T22:34:36.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49112 req_id = 89db9f4c-d5a5-49e2-8288-5d878d7846fc response_code = 200 uri = /v2p
21802025-01-14T22:34:36.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 446 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46863 req_id = 408a2e03-c6a7-4e7c-8af4-5b57fe269c4e response_code = 200 uri = /vpc-routes
21812025-01-14T22:34:36.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60866 req_id = 0a29557c-585c-47a7-b7cf-3f87c3e17b81 response_code = 200 uri = /network-bootstore-config
21822025-01-14T22:34:36.515ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49789
21832025-01-14T22:34:36.516ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21842025-01-14T22:34:36.562ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21852025-01-14T22:34:36.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106322 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49789 req_id = 872a500e-7a45-4eca-a118-2d6277283d67 response_code = 204 uri = /switch-ports
21862025-01-14T22:34:36.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33964
21872025-01-14T22:34:36.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63639
21882025-01-14T22:34:36.622ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
21892025-01-14T22:34:36.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46863 req_id = 1e9910da-07e1-4a29-820e-c90237260765 response_code = 204 uri = /eip-gateways
21902025-01-14T22:34:36.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33964 req_id = e09ecc83-8974-4d49-a186-154dd465ff85 response_code = 200 uri = /vpc-routes
21912025-01-14T22:34:36.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49789 req_id = 93c87914-d339-4b29-a3af-7bf0fcbd948c response_code = 200 uri = /network-bootstore-config
21922025-01-14T22:34:36.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63639 req_id = d51d409b-bc56-48b3-a4fd-2e3b86d5e2cf response_code = 200 uri = /v2p
21932025-01-14T22:34:36.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53834
21942025-01-14T22:34:36.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53834 req_id = 8a7bd9fa-c076-46b7-ade8-1b086f154e11 response_code = 200 uri = /v2p
21952025-01-14T22:34:36.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64170
21962025-01-14T22:34:36.636ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21972025-01-14T22:34:36.675ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21982025-01-14T22:34:36.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96374 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64170 req_id = 6158fba1-4b6b-4b67-be92-fc698f09ec70 response_code = 204 uri = /switch-ports
21992025-01-14T22:34:36.733ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
22002025-01-14T22:34:36.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33964 req_id = fd37d590-7cd6-4100-9caf-dda5c904243a response_code = 204 uri = /eip-gateways
22012025-01-14T22:34:36.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64170 req_id = 08eefd8b-ee95-4a08-b0e5-480723d6eaa3 response_code = 200 uri = /network-bootstore-config
22022025-01-14T22:34:36.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 487 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46863 req_id = 015fb889-6d96-43a4-af7f-722fe1398572 response_code = 204 uri = /vpc-routes
22032025-01-14T22:34:36.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33964 req_id = 88b39990-480a-4f39-bf7b-c83bfe955166 response_code = 204 uri = /vpc-routes
22042025-01-14T22:34:56.047ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63974
22052025-01-14T22:34:56.047ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63974 req_id = fc508b9d-9385-400c-8332-8f9fd46cfb6d response_code = 200 uri = /baseboard
22062025-01-14T22:35:04.014ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6828 local_addr = [fd00:1122:3344:101::1]:50816 method = GET remote_addr = [fd00:1122:3344:101::d]:55313 req_id = e8de67b3-fce9-4325-b702-0d9e6086a3fc response_code = 200 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 uri = /652f7dd4-af0c-42f1-b515-fb2bf74375f9
22072025-01-14T22:35:06.088ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44981
22082025-01-14T22:35:06.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44981 req_id = 49f8a525-38f5-4d35-837e-5f68d70d2542 response_code = 200 uri = /vpc-routes
22092025-01-14T22:35:06.131ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42507
22102025-01-14T22:35:06.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42507 req_id = f905fd17-65f6-4583-a528-78528fe21869 response_code = 200 uri = /vpc-routes
22112025-01-14T22:35:06.158ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
22122025-01-14T22:35:06.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44981 req_id = bc6b031c-208c-4407-8618-9cedca7f2b67 response_code = 204 uri = /eip-gateways
22132025-01-14T22:35:06.202ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
22142025-01-14T22:35:06.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42507 req_id = 2e4f3611-a0ac-4ee3-a9fb-1bc7fb1f415f response_code = 204 uri = /eip-gateways
22152025-01-14T22:35:06.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34602
22162025-01-14T22:35:06.238ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22172025-01-14T22:35:06.284ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22182025-01-14T22:35:06.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119703 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34602 req_id = 6fab1233-dbeb-4fe1-a5eb-3730c0ac80cd response_code = 204 uri = /switch-ports
22192025-01-14T22:35:06.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42346
22202025-01-14T22:35:06.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59149
22212025-01-14T22:35:06.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42346 req_id = e8aaa254-9495-4caf-ae6a-985963199993 response_code = 200 uri = /vpc-routes
22222025-01-14T22:35:06.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34602 req_id = 66c97db9-6df3-42c8-83d5-ef03b98ba440 response_code = 200 uri = /network-bootstore-config
22232025-01-14T22:35:06.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 495 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42507 req_id = 7a6956e5-f05e-4391-a9f0-9f80cee7604f response_code = 204 uri = /vpc-routes
22242025-01-14T22:35:06.360ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22252025-01-14T22:35:06.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45149
22262025-01-14T22:35:06.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 460 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45149 req_id = bd92510d-533a-41fd-8378-95e340f4edf0 response_code = 200 uri = /v2p
22272025-01-14T22:35:06.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 578 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44981 req_id = 8b7f60cb-0b59-4ea2-a97e-bc39e378cd4a response_code = 204 uri = /vpc-routes
22282025-01-14T22:35:06.408ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22292025-01-14T22:35:06.412ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
22302025-01-14T22:35:06.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 642 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42346 req_id = 379d5666-57a3-4e88-8d6f-00f70d3e64c2 response_code = 204 uri = /eip-gateways
22312025-01-14T22:35:06.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44681
22322025-01-14T22:35:06.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1099 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42346 req_id = 470af4ff-e9c5-45cb-bf44-43d882d285ef response_code = 204 uri = /vpc-routes
22332025-01-14T22:35:06.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52984
22342025-01-14T22:35:06.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52984 req_id = caa432b2-4fef-4785-a249-4f62890c14ed response_code = 200 uri = /v2p
22352025-01-14T22:35:06.472ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22362025-01-14T22:35:06.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112559 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59149 req_id = d9c00f3d-59ed-4e4d-92c4-f51ad4678042 response_code = 204 uri = /switch-ports
22372025-01-14T22:35:06.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 733 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59149 req_id = b37b77e4-a7ae-4389-aa4f-322b8d9ac288 response_code = 200 uri = /network-bootstore-config
22382025-01-14T22:35:06.512ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22392025-01-14T22:35:06.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42315
22402025-01-14T22:35:06.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42315 req_id = 4cc80128-52a4-420a-9862-365b64ca1985 response_code = 200 uri = /v2p
22412025-01-14T22:35:06.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160671 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44681 req_id = 477e08c0-4d30-4f8a-ac0f-a178b95f6d7f response_code = 204 uri = /switch-ports
22422025-01-14T22:35:06.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44681 req_id = 6b9918e2-e86f-4d54-8e5d-2af3c6c68156 response_code = 200 uri = /network-bootstore-config
22432025-01-14T22:35:26.080ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55768
22442025-01-14T22:35:26.080ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55768 req_id = f52e0301-498e-4e6a-a14a-2f19ebfc56be response_code = 200 uri = /baseboard
22452025-01-14T22:35:34.013ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5675 local_addr = [fd00:1122:3344:101::1]:50816 method = GET remote_addr = [fd00:1122:3344:101::d]:55313 req_id = baf520b3-1a02-459b-a2af-7c16c34144b8 response_code = 200 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 uri = /652f7dd4-af0c-42f1-b515-fb2bf74375f9
22462025-01-14T22:35:36.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36819
22472025-01-14T22:35:36.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36819 req_id = f0b1604a-2f8b-4485-9e65-70dce551e216 response_code = 200 uri = /vpc-routes
22482025-01-14T22:35:36.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39049
22492025-01-14T22:35:36.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39049 req_id = 0509ba1b-3443-4feb-9939-5bfc3c9028d3 response_code = 200 uri = /vpc-routes
22502025-01-14T22:35:36.367ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
22512025-01-14T22:35:36.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39049 req_id = fc69797f-2852-47d0-bb62-8986f291b93d response_code = 204 uri = /eip-gateways
22522025-01-14T22:35:36.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59701
22532025-01-14T22:35:36.403ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22542025-01-14T22:35:36.439ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22552025-01-14T22:35:36.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109754 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59701 req_id = 62ff392d-8766-4ef0-abc0-36e2ba2cd470 response_code = 204 uri = /switch-ports
22562025-01-14T22:35:36.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58329
22572025-01-14T22:35:36.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60449
22582025-01-14T22:35:36.514ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
22592025-01-14T22:35:36.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36819 req_id = 08507fe6-6df1-40c6-932e-ca557edbb223 response_code = 204 uri = /eip-gateways
22602025-01-14T22:35:36.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59459
22612025-01-14T22:35:36.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 350 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59701 req_id = 52b535c3-7df5-4a28-ab9e-917d6a17eb74 response_code = 200 uri = /network-bootstore-config
22622025-01-14T22:35:36.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60449 req_id = f8969953-6b37-403c-bb04-5bd91b11c929 response_code = 200 uri = /v2p
22632025-01-14T22:35:36.514ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22642025-01-14T22:35:36.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 722 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39049 req_id = 6658ba0b-b508-4d2f-b1ba-a60853c6fb1d response_code = 204 uri = /vpc-routes
22652025-01-14T22:35:36.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 393 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58329 req_id = 1eeb74cc-97ad-4c04-bbc0-fcf123004c62 response_code = 200 uri = /vpc-routes
22662025-01-14T22:35:36.554ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56023
22672025-01-14T22:35:36.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56023 req_id = ae739957-5d1d-40ab-940c-2bdd5123d805 response_code = 200 uri = /v2p
22682025-01-14T22:35:36.559ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22692025-01-14T22:35:36.565ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
22702025-01-14T22:35:36.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58329 req_id = 015ead6b-0d74-4f53-ad7e-61fea030bdc1 response_code = 204 uri = /eip-gateways
22712025-01-14T22:35:36.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58329 req_id = 00e39671-566e-4876-811b-968890670890 response_code = 204 uri = /vpc-routes
22722025-01-14T22:35:36.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36819 req_id = 949d0608-607f-4379-a022-ebb6a7564368 response_code = 204 uri = /vpc-routes
22732025-01-14T22:35:36.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109513 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59459 req_id = 82a14864-14a4-4bc5-b3b8-421f0b63774f response_code = 204 uri = /switch-ports
22742025-01-14T22:35:36.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59459 req_id = 26d5f5ac-77d0-4002-be61-fb06fc1da563 response_code = 200 uri = /network-bootstore-config
22752025-01-14T22:35:36.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53193
22762025-01-14T22:35:36.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53193 req_id = 88ddab58-7e57-4967-abcb-41b998ebf25f response_code = 200 uri = /v2p
22772025-01-14T22:35:36.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55061
22782025-01-14T22:35:36.739ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22792025-01-14T22:35:36.778ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22802025-01-14T22:35:36.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94052 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55061 req_id = 8013a635-4d5a-4e4e-81d4-9d5f0e7cddff response_code = 204 uri = /switch-ports
22812025-01-14T22:35:36.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55061 req_id = a0b93a78-be0a-403e-b036-c1aac6787a90 response_code = 200 uri = /network-bootstore-config
22822025-01-14T22:35:56.114ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39333
22832025-01-14T22:35:56.114ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39333 req_id = 291bc33c-a260-418b-92b6-010843e9418f response_code = 200 uri = /baseboard
22842025-01-14T22:36:04.015ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7172 local_addr = [fd00:1122:3344:101::1]:50816 method = GET remote_addr = [fd00:1122:3344:101::d]:55313 req_id = 4c1d655e-1218-4900-a07f-a41ab62c586b response_code = 200 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 uri = /652f7dd4-af0c-42f1-b515-fb2bf74375f9
22852025-01-14T22:36:06.068ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40463
22862025-01-14T22:36:06.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40463 req_id = 8000b81e-6e65-48ec-b152-f14f7bfb44f2 response_code = 200 uri = /vpc-routes
22872025-01-14T22:36:06.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48101
22882025-01-14T22:36:06.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48101 req_id = 2ad48d51-4452-4f7d-b81f-b016c5e0b34f response_code = 200 uri = /vpc-routes
22892025-01-14T22:36:06.154ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
22902025-01-14T22:36:06.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40463 req_id = 6e87149c-dfb8-473b-9fcb-2354ad372fdd response_code = 204 uri = /eip-gateways
22912025-01-14T22:36:06.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40463 req_id = 3a88d85b-e631-4b18-8a84-33fd67422ac4 response_code = 204 uri = /vpc-routes
22922025-01-14T22:36:06.205ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48102
22932025-01-14T22:36:06.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48102 req_id = 174f34c6-65e6-4778-8aff-23b225e076e4 response_code = 200 uri = /v2p
22942025-01-14T22:36:06.242ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42190
22952025-01-14T22:36:06.242ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22962025-01-14T22:36:06.290ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22972025-01-14T22:36:06.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109736 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42190 req_id = 71258063-0a72-4d1b-9703-299f9daf1aea response_code = 204 uri = /switch-ports
22982025-01-14T22:36:06.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62162
22992025-01-14T22:36:06.352ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
23002025-01-14T22:36:06.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48101 req_id = f7e2895d-2ac6-43df-a10f-0e37d0c0f116 response_code = 204 uri = /eip-gateways
23012025-01-14T22:36:06.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50876
23022025-01-14T22:36:06.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42190 req_id = 3ac2ed76-7f19-40c6-8b39-ecc92bd66267 response_code = 200 uri = /network-bootstore-config
23032025-01-14T22:36:06.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62162 req_id = 61a1b8ee-628c-4437-acb7-59c190b87891 response_code = 200 uri = /v2p
23042025-01-14T22:36:06.353ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23052025-01-14T22:36:06.360ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55907
23062025-01-14T22:36:06.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55907 req_id = 3de77b99-496e-401d-a3e7-3ac43df848d9 response_code = 200 uri = /vpc-routes
23072025-01-14T22:36:06.392ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23082025-01-14T22:36:06.403ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
23092025-01-14T22:36:06.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55907 req_id = ef231116-da0d-4dfa-8db5-1dfa879c093e response_code = 204 uri = /eip-gateways
23102025-01-14T22:36:06.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55907 req_id = dbf7796c-aa15-46cb-a33e-598b3fdc7227 response_code = 204 uri = /vpc-routes
23112025-01-14T22:36:06.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100869 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50876 req_id = 9eec7b02-6391-4bcc-a248-42bc5973c231 response_code = 204 uri = /switch-ports
23122025-01-14T22:36:06.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50876 req_id = 04ea17cb-52a4-4fd2-8925-c882888c828c response_code = 200 uri = /network-bootstore-config
23132025-01-14T22:36:06.548ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62231
23142025-01-14T22:36:06.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62231 req_id = 35c7f029-be01-4c89-853d-12ac2cb89c56 response_code = 200 uri = /v2p
23152025-01-14T22:36:06.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48101 req_id = bfcf92a5-9689-4af0-a119-68ed4c7b9584 response_code = 204 uri = /vpc-routes
23162025-01-14T22:36:06.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37713
23172025-01-14T22:36:06.568ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23182025-01-14T22:36:06.603ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23192025-01-14T22:36:06.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88909 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37713 req_id = 2ba761d1-6471-475b-aeb5-a0835811998c response_code = 204 uri = /switch-ports
23202025-01-14T22:36:06.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37713 req_id = 61431d1f-be97-4fbd-93d8-9efc381b1182 response_code = 200 uri = /network-bootstore-config
23212025-01-14T22:36:26.149ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48205
23222025-01-14T22:36:26.150ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48205 req_id = 1fc0402a-aee1-4cb6-8c9a-ac86376993e9 response_code = 200 uri = /baseboard
23232025-01-14T22:36:34.015ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6239 local_addr = [fd00:1122:3344:101::1]:50816 method = GET remote_addr = [fd00:1122:3344:101::d]:55313 req_id = 55c9fd19-925c-41fd-9133-b7329c6f0484 response_code = 200 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 uri = /652f7dd4-af0c-42f1-b515-fb2bf74375f9
23242025-01-14T22:36:36.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36731
23252025-01-14T22:36:36.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36731 req_id = 4c014bb2-3dda-44ec-9720-caf3fc6d0dd2 response_code = 200 uri = /vpc-routes
23262025-01-14T22:36:36.372ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
23272025-01-14T22:36:36.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36731 req_id = 7039767b-5e15-4038-a9ec-091027144fdb response_code = 204 uri = /eip-gateways
23282025-01-14T22:36:36.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36731 req_id = 3e945d83-55c9-41cd-a1f5-3c821aa6f9ce response_code = 204 uri = /vpc-routes
23292025-01-14T22:36:36.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46539
23302025-01-14T22:36:36.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46539 req_id = 8a876f84-4d0f-4ed5-af32-bccd6c0df080 response_code = 200 uri = /v2p
23312025-01-14T22:36:36.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64071
23322025-01-14T22:36:36.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64071 req_id = 4517e215-eaf6-43b7-9aa9-185d9090d204 response_code = 200 uri = /vpc-routes
23332025-01-14T22:36:36.425ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52709
23342025-01-14T22:36:36.425ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23352025-01-14T22:36:36.468ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23362025-01-14T22:36:36.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111176 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52709 req_id = 3a9c444c-f97b-4498-bef5-bcc6948aa96c response_code = 204 uri = /switch-ports
23372025-01-14T22:36:36.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46502
23382025-01-14T22:36:36.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42392
23392025-01-14T22:36:36.537ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
23402025-01-14T22:36:36.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64071 req_id = a0ded3c8-89c1-4be8-9b35-8f7bfd31c425 response_code = 204 uri = /eip-gateways
23412025-01-14T22:36:36.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52709 req_id = f4c309bd-32ab-42fb-baee-749b1d0a0124 response_code = 200 uri = /network-bootstore-config
23422025-01-14T22:36:36.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46502 req_id = ffe62b23-c883-4655-b7f7-debc833bd671 response_code = 200 uri = /v2p
23432025-01-14T22:36:36.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42392 req_id = 181f1f92-9a91-4a1d-bb3e-1d7fd8a65446 response_code = 200 uri = /vpc-routes
23442025-01-14T22:36:36.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 410 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64071 req_id = 0b9c8880-d82a-4e8c-aaf4-7efebcb7f70b response_code = 204 uri = /vpc-routes
23452025-01-14T22:36:36.557ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62959
23462025-01-14T22:36:36.557ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23472025-01-14T22:36:36.599ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23482025-01-14T22:36:36.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104457 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62959 req_id = 4f6bd8f8-0db9-4db7-b382-3a15a06504d7 response_code = 204 uri = /switch-ports
23492025-01-14T22:36:36.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36354
23502025-01-14T22:36:36.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45276
23512025-01-14T22:36:36.662ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
23522025-01-14T22:36:36.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42392 req_id = 32391a6b-e450-45db-b674-5c0f27ae3093 response_code = 204 uri = /eip-gateways
23532025-01-14T22:36:36.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62959 req_id = df478410-920a-4541-b5f2-7ae4bba9a2fc response_code = 200 uri = /network-bootstore-config
23542025-01-14T22:36:36.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45276 req_id = f8700a36-be76-4169-825a-357cde87539d response_code = 200 uri = /v2p
23552025-01-14T22:36:36.663ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41868
23562025-01-14T22:36:36.663ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23572025-01-14T22:36:36.670ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 08ab3e6f-8169-4727-9bfd-8dd0f022af2c, kind: Service { id: a66dcc60-1225-4e39-ab1a-b70caf5209e9 }, name: Name("external-dns-a66dcc60-1225-4e39-ab1a-b70caf5209e9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd47cf7f-251c-4290-8688-7e2060f2050c, kind: Service { id: 696becfd-808e-490f-8687-0b1b89035dda }, name: Name("external-dns-696becfd-808e-490f-8687-0b1b89035dda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 187])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0db76917-acaf-4b6b-8dbb-d22b559cd940, kind: Service { id: e1b2ab23-7976-4ea8-a2a7-c53e015d5764 }, name: Name("nexus-e1b2ab23-7976-4ea8-a2a7-c53e015d5764"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 922e49e1-e5c9-4471-b22f-5e46cae983ea, kind: Service { id: 3203df94-bda8-401f-99df-30e90a5f076d }, name: Name("nexus-3203df94-bda8-401f-99df-30e90a5f076d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9ca98b6d-c3b4-4bfe-a1f8-0d99a0a5ce6f, kind: Service { id: b0506d4d-8223-4315-9fa0-31e028a676f3 }, name: Name("nexus-b0506d4d-8223-4315-9fa0-31e028a676f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23582025-01-14T22:36:36.670ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23592025-01-14T22:36:36.670ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23602025-01-14T22:36:36.670ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23612025-01-14T22:36:36.670ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23622025-01-14T22:36:36.670ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23632025-01-14T22:36:36.670ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23642025-01-14T22:36:36.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1035 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36354 req_id = 870aaccf-c06c-4235-8ecd-c4438fdda42b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23652025-01-14T22:36:36.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 489 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42392 req_id = 1fa286a7-7ca6-4edf-b446-3bd082af80db response_code = 204 uri = /vpc-routes
23662025-01-14T22:36:36.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38366
23672025-01-14T22:36:36.707ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 08ab3e6f-8169-4727-9bfd-8dd0f022af2c, kind: Service { id: a66dcc60-1225-4e39-ab1a-b70caf5209e9 }, name: Name("external-dns-a66dcc60-1225-4e39-ab1a-b70caf5209e9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd47cf7f-251c-4290-8688-7e2060f2050c, kind: Service { id: 696becfd-808e-490f-8687-0b1b89035dda }, name: Name("external-dns-696becfd-808e-490f-8687-0b1b89035dda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 187])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0db76917-acaf-4b6b-8dbb-d22b559cd940, kind: Service { id: e1b2ab23-7976-4ea8-a2a7-c53e015d5764 }, name: Name("nexus-e1b2ab23-7976-4ea8-a2a7-c53e015d5764"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 922e49e1-e5c9-4471-b22f-5e46cae983ea, kind: Service { id: 3203df94-bda8-401f-99df-30e90a5f076d }, name: Name("nexus-3203df94-bda8-401f-99df-30e90a5f076d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9ca98b6d-c3b4-4bfe-a1f8-0d99a0a5ce6f, kind: Service { id: b0506d4d-8223-4315-9fa0-31e028a676f3 }, name: Name("nexus-b0506d4d-8223-4315-9fa0-31e028a676f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23682025-01-14T22:36:36.707ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23692025-01-14T22:36:36.707ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23702025-01-14T22:36:36.707ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23712025-01-14T22:36:36.707ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23722025-01-14T22:36:36.707ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23732025-01-14T22:36:36.707ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23742025-01-14T22:36:36.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 475 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38366 req_id = 0c802875-8fc3-4b78-a8b2-5cf3dd9fbe70 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23752025-01-14T22:36:36.708ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23762025-01-14T22:36:36.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107208 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41868 req_id = 29ad80ce-8488-44e4-b558-91225ca98c40 response_code = 204 uri = /switch-ports
23772025-01-14T22:36:36.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41868 req_id = 5870977a-af1a-4cd6-a03e-dcd6d08ffb20 response_code = 200 uri = /network-bootstore-config
23782025-01-14T22:36:36.781ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47344
23792025-01-14T22:36:36.781ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 08ab3e6f-8169-4727-9bfd-8dd0f022af2c, kind: Service { id: a66dcc60-1225-4e39-ab1a-b70caf5209e9 }, name: Name("external-dns-a66dcc60-1225-4e39-ab1a-b70caf5209e9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd47cf7f-251c-4290-8688-7e2060f2050c, kind: Service { id: 696becfd-808e-490f-8687-0b1b89035dda }, name: Name("external-dns-696becfd-808e-490f-8687-0b1b89035dda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 187])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0db76917-acaf-4b6b-8dbb-d22b559cd940, kind: Service { id: e1b2ab23-7976-4ea8-a2a7-c53e015d5764 }, name: Name("nexus-e1b2ab23-7976-4ea8-a2a7-c53e015d5764"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 922e49e1-e5c9-4471-b22f-5e46cae983ea, kind: Service { id: 3203df94-bda8-401f-99df-30e90a5f076d }, name: Name("nexus-3203df94-bda8-401f-99df-30e90a5f076d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9ca98b6d-c3b4-4bfe-a1f8-0d99a0a5ce6f, kind: Service { id: b0506d4d-8223-4315-9fa0-31e028a676f3 }, name: Name("nexus-b0506d4d-8223-4315-9fa0-31e028a676f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23802025-01-14T22:36:36.781ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23812025-01-14T22:36:36.781ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23822025-01-14T22:36:36.781ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23832025-01-14T22:36:36.781ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23842025-01-14T22:36:36.781ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23852025-01-14T22:36:36.781ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23862025-01-14T22:36:36.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 377 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47344 req_id = 5c2cc03c-a7e5-45db-a280-9bc33d8d9583 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23872025-01-14T22:36:56.184ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36799
23882025-01-14T22:36:56.184ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36799 req_id = e2648eeb-1b31-4d61-a7ef-139437e7f743 response_code = 200 uri = /baseboard
23892025-01-14T22:37:04.015ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5666 local_addr = [fd00:1122:3344:101::1]:50816 method = GET remote_addr = [fd00:1122:3344:101::d]:55313 req_id = e85422ca-ea08-4d21-bc00-937f3666646b response_code = 200 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 uri = /652f7dd4-af0c-42f1-b515-fb2bf74375f9
23902025-01-14T22:37:06.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46768
23912025-01-14T22:37:06.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46768 req_id = 0a6e6935-d0c5-43b6-b8f7-838cf512f19b response_code = 200 uri = /vpc-routes
23922025-01-14T22:37:06.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35545
23932025-01-14T22:37:06.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35545 req_id = 849cedaf-18bc-4f6c-aa90-49adab942a9c response_code = 200 uri = /vpc-routes
23942025-01-14T22:37:06.159ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
23952025-01-14T22:37:06.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46768 req_id = 4858ea01-e398-447d-8a41-30bb64132b21 response_code = 204 uri = /eip-gateways
23962025-01-14T22:37:06.166ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
23972025-01-14T22:37:06.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35545 req_id = 9a4fd089-b51c-4660-a460-f4864b281f7f response_code = 204 uri = /eip-gateways
23982025-01-14T22:37:06.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46768 req_id = 92beba68-8906-4d60-82c7-e13542286bad response_code = 204 uri = /vpc-routes
23992025-01-14T22:37:06.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35545 req_id = 492c8868-a3cd-4d62-84e0-60abcaf73f0c response_code = 204 uri = /vpc-routes
24002025-01-14T22:37:06.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62016
24012025-01-14T22:37:06.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62016 req_id = ee7802f5-ec7d-4f9a-8b27-4cffe6a3c5d0 response_code = 200 uri = /v2p
24022025-01-14T22:37:06.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61232
24032025-01-14T22:37:06.217ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24042025-01-14T22:37:06.259ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24052025-01-14T22:37:06.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97306 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61232 req_id = f4aca514-f9a5-4f7c-9074-828d3a009c4b response_code = 204 uri = /switch-ports
24062025-01-14T22:37:06.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40733
24072025-01-14T22:37:06.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42402
24082025-01-14T22:37:06.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61232 req_id = 83ff19f4-681f-4a76-833d-01cae2c95de8 response_code = 200 uri = /network-bootstore-config
24092025-01-14T22:37:06.316ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24102025-01-14T22:37:06.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40733 req_id = 3d0bc45f-f855-4f0a-91f6-1300b078a290 response_code = 200 uri = /v2p
24112025-01-14T22:37:06.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36769
24122025-01-14T22:37:06.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36769 req_id = 8a72f7bd-01a2-4929-9bac-85acef1258f2 response_code = 200 uri = /vpc-routes
24132025-01-14T22:37:06.354ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24142025-01-14T22:37:06.400ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
24152025-01-14T22:37:06.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36769 req_id = a1e94fe0-ab8f-4c49-8930-a7e04d842c34 response_code = 204 uri = /eip-gateways
24162025-01-14T22:37:06.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1039 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36769 req_id = 0b9bbcb0-397f-4023-a590-61e27cfa2167 response_code = 204 uri = /vpc-routes
24172025-01-14T22:37:06.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116416 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42402 req_id = 586f5f62-9300-4305-89cf-ed8e0598529f response_code = 204 uri = /switch-ports
24182025-01-14T22:37:06.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42402 req_id = 4e6dc216-a303-4dda-93db-e42d569dd45d response_code = 200 uri = /network-bootstore-config
24192025-01-14T22:37:06.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47328
24202025-01-14T22:37:06.465ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24212025-01-14T22:37:06.505ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24222025-01-14T22:37:06.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94628 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47328 req_id = 5bb6c177-8d46-4b42-9db2-05a9ed920c5e response_code = 204 uri = /switch-ports
24232025-01-14T22:37:06.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36506
24242025-01-14T22:37:06.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36506 req_id = f3bc7bdc-ce4b-4de9-b2c0-086121df58f1 response_code = 200 uri = /v2p
24252025-01-14T22:37:06.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47328 req_id = 3c370a4a-a778-41e3-a56b-7bb0c363220b response_code = 200 uri = /network-bootstore-config
24262025-01-14T22:37:26.218ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63313
24272025-01-14T22:37:26.218ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63313 req_id = 6f1fa9ff-96fd-411f-8ea5-79978a079f8d response_code = 200 uri = /baseboard
24282025-01-14T22:37:34.017ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6841 local_addr = [fd00:1122:3344:101::1]:50816 method = GET remote_addr = [fd00:1122:3344:101::d]:55313 req_id = e1b68097-9c4a-45f1-b185-d77a1f3a02bc response_code = 200 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 uri = /652f7dd4-af0c-42f1-b515-fb2bf74375f9
24292025-01-14T22:37:34.812ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24302025-01-14T22:37:34.812ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24312025-01-14T22:37:34.849ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 2062, tv_nsec: 481071508 } time_to_next_cleanup = 599.99999592s
24322025-01-14T22:37:36.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64238
24332025-01-14T22:37:36.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64238 req_id = 3ed49cd1-f202-4ba9-870a-928aff4e0296 response_code = 200 uri = /vpc-routes
24342025-01-14T22:37:36.351ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
24352025-01-14T22:37:36.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64238 req_id = 90d69b7b-9ea4-48c3-9f7a-71703519bef0 response_code = 204 uri = /eip-gateways
24362025-01-14T22:37:36.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64238 req_id = f6355aef-1b86-4d8d-bea5-81e1802d1991 response_code = 204 uri = /vpc-routes
24372025-01-14T22:37:36.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42298
24382025-01-14T22:37:36.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42298 req_id = d4a27a63-326f-471e-af01-f597de5c77de response_code = 200 uri = /vpc-routes
24392025-01-14T22:37:36.417ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
24402025-01-14T22:37:36.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42298 req_id = 5cbd4d7b-ddc5-4836-8b76-64e370786da8 response_code = 204 uri = /eip-gateways
24412025-01-14T22:37:36.472ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62107
24422025-01-14T22:37:36.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62107 req_id = 4f823208-e01f-4735-bb13-f45b1bbb72d8 response_code = 200 uri = /v2p
24432025-01-14T22:37:36.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42298 req_id = b7d184ad-34e7-4f09-8d20-35da7ada9055 response_code = 204 uri = /vpc-routes
24442025-01-14T22:37:36.488ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39352
24452025-01-14T22:37:36.488ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24462025-01-14T22:37:36.527ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24472025-01-14T22:37:36.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94938 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39352 req_id = 2e0de91f-fc79-48ad-ac5a-1d4fa9e5b3ca response_code = 204 uri = /switch-ports
24482025-01-14T22:37:36.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63366
24492025-01-14T22:37:36.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34478
24502025-01-14T22:37:36.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37809
24512025-01-14T22:37:36.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39352 req_id = 91415531-6b00-4091-8b91-4d4e110abb97 response_code = 200 uri = /network-bootstore-config
24522025-01-14T22:37:36.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63366 req_id = 9ccdcc00-0d8c-426e-9ad8-a0d9a404dd1c response_code = 200 uri = /vpc-routes
24532025-01-14T22:37:36.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37809 req_id = 60ce8602-2f8a-4b86-a3e1-2139ae8c02de response_code = 200 uri = /v2p
24542025-01-14T22:37:36.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34478 req_id = b328f87c-3bf6-47d1-8799-ef10ef3ccefd response_code = 200 uri = /v2p
24552025-01-14T22:37:36.589ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33932
24562025-01-14T22:37:36.590ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24572025-01-14T22:37:36.627ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24582025-01-14T22:37:36.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94071 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33932 req_id = 38529d94-de68-4c4d-b575-d2bd4406733e response_code = 204 uri = /switch-ports
24592025-01-14T22:37:36.684ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37958
24602025-01-14T22:37:36.684ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
24612025-01-14T22:37:36.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63366 req_id = 595294b9-b2ea-4b0f-bf05-75ddaaa9bdfd response_code = 204 uri = /eip-gateways
24622025-01-14T22:37:36.684ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24632025-01-14T22:37:36.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33932 req_id = 75b7c71b-f4d7-4754-a3d5-8d398dc8feb6 response_code = 200 uri = /network-bootstore-config
24642025-01-14T22:37:36.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63366 req_id = 09ec2f0a-729d-4b0e-ad7f-0876b9a8dfc3 response_code = 204 uri = /vpc-routes
24652025-01-14T22:37:36.722ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24662025-01-14T22:37:36.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93783 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37958 req_id = 3ee7761c-e4d9-4dfa-9884-a742c0877e4e response_code = 204 uri = /switch-ports
24672025-01-14T22:37:36.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37958 req_id = 61ea9b0b-be22-4087-b853-95e77994d9f8 response_code = 200 uri = /network-bootstore-config
24682025-01-14T22:37:49.144ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24692025-01-14T22:37:56.252ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46967
24702025-01-14T22:37:56.252ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46967 req_id = e23de0fa-d61f-46e7-b86b-ca83a1ac18b6 response_code = 200 uri = /baseboard
24712025-01-14T22:38:04.016ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6416 local_addr = [fd00:1122:3344:101::1]:50816 method = GET remote_addr = [fd00:1122:3344:101::d]:55313 req_id = bb9a6a8e-5a47-4fdd-8487-7088765ba227 response_code = 200 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 uri = /652f7dd4-af0c-42f1-b515-fb2bf74375f9
24722025-01-14T22:38:06.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43594
24732025-01-14T22:38:06.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43594 req_id = f705e1ae-d2e8-4a07-a804-0d07a5c36208 response_code = 200 uri = /vpc-routes
24742025-01-14T22:38:06.167ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
24752025-01-14T22:38:06.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43594 req_id = 86590cca-1824-4146-91f5-b838dab08139 response_code = 204 uri = /eip-gateways
24762025-01-14T22:38:06.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43594 req_id = b446f7ab-1a93-4177-886d-04e978f05013 response_code = 204 uri = /vpc-routes
24772025-01-14T22:38:06.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35621
24782025-01-14T22:38:06.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35621 req_id = 1ef74145-03c6-43c0-b9b4-0bc92b9ef1c8 response_code = 200 uri = /vpc-routes
24792025-01-14T22:38:06.211ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50949
24802025-01-14T22:38:06.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50949 req_id = ac27519d-0fd4-47ca-a816-9d4750a953aa response_code = 200 uri = /v2p
24812025-01-14T22:38:06.229ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62194
24822025-01-14T22:38:06.229ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24832025-01-14T22:38:06.273ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24842025-01-14T22:38:06.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102726 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62194 req_id = 444c1c52-0ab9-4c89-ae11-7d76004535b4 response_code = 204 uri = /switch-ports
24852025-01-14T22:38:06.332ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40861
24862025-01-14T22:38:06.332ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
24872025-01-14T22:38:06.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35621 req_id = 281b115c-b87e-4464-8b32-01712295c39e response_code = 204 uri = /eip-gateways
24882025-01-14T22:38:06.332ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35979
24892025-01-14T22:38:06.333ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24902025-01-14T22:38:06.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62194 req_id = 308a792a-47bd-4a6a-bb9d-a1afe8ae7b68 response_code = 200 uri = /network-bootstore-config
24912025-01-14T22:38:06.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40861 req_id = aa640081-1604-4e0e-9fd4-675e52f856c4 response_code = 200 uri = /v2p
24922025-01-14T22:38:06.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35621 req_id = 25fff67e-090c-4d6d-a20d-f86a30d41aae response_code = 204 uri = /vpc-routes
24932025-01-14T22:38:06.370ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24942025-01-14T22:38:06.377ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42096
24952025-01-14T22:38:06.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42096 req_id = 17e1b23a-d784-4462-85b1-4ed1e958e601 response_code = 200 uri = /vpc-routes
24962025-01-14T22:38:06.419ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
24972025-01-14T22:38:06.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 692 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42096 req_id = 7a9295fe-d146-4fae-b17c-6885f43c02b6 response_code = 204 uri = /eip-gateways
24982025-01-14T22:38:06.425ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44279
24992025-01-14T22:38:06.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44279 req_id = 12f4d343-9e13-4ca4-ae59-da04ba49b444 response_code = 200 uri = /v2p
25002025-01-14T22:38:06.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94806 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35979 req_id = d607c63b-2bbe-4099-b885-38b33b7c0223 response_code = 204 uri = /switch-ports
25012025-01-14T22:38:06.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35979 req_id = 335960ce-fd50-49b9-a7e6-50fdc14ce9ef response_code = 200 uri = /network-bootstore-config
25022025-01-14T22:38:06.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42096 req_id = 87655660-7b80-4932-99d6-85f94c82a4a4 response_code = 204 uri = /vpc-routes
25032025-01-14T22:38:06.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36566
25042025-01-14T22:38:06.469ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25052025-01-14T22:38:06.506ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25062025-01-14T22:38:06.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90645 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36566 req_id = 923677af-21c8-4da0-9c7b-861c7ab5bb75 response_code = 204 uri = /switch-ports
25072025-01-14T22:38:06.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36566 req_id = 350aa6a0-41d8-4645-b69f-9a6b11a0c7ab response_code = 200 uri = /network-bootstore-config
25082025-01-14T22:38:26.287ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47071
25092025-01-14T22:38:26.287ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47071 req_id = c8e354c5-d8cb-4ab4-a1d9-3152c859112f response_code = 200 uri = /baseboard
25102025-01-14T22:38:34.016ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5560 local_addr = [fd00:1122:3344:101::1]:50816 method = GET remote_addr = [fd00:1122:3344:101::d]:55313 req_id = dff579fe-081e-43b0-bb2c-b6fc26878121 response_code = 200 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 uri = /652f7dd4-af0c-42f1-b515-fb2bf74375f9
25112025-01-14T22:38:36.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47015
25122025-01-14T22:38:36.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47015 req_id = 313ad841-7b96-41c4-84b2-4149e21c677b response_code = 200 uri = /v2p
25132025-01-14T22:38:36.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35820
25142025-01-14T22:38:36.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35820 req_id = 6186b184-e27c-4151-84f9-4dda0d8dfba7 response_code = 200 uri = /vpc-routes
25152025-01-14T22:38:36.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43526
25162025-01-14T22:38:36.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43526 req_id = 44d9a61f-1834-4f6b-9d74-feda52c9d911 response_code = 200 uri = /vpc-routes
25172025-01-14T22:38:36.321ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
25182025-01-14T22:38:36.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35820 req_id = 78d40fcc-6f5e-41b3-8ba1-96da1bd7f199 response_code = 204 uri = /eip-gateways
25192025-01-14T22:38:36.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52353
25202025-01-14T22:38:36.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52353 req_id = 4f3611ff-f1e2-41a9-9ca2-14be00b1deb2 response_code = 200 uri = /v2p
25212025-01-14T22:38:36.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35820 req_id = 8ae14573-a60b-47fc-82a2-54cf9555096a response_code = 204 uri = /vpc-routes
25222025-01-14T22:38:36.374ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
25232025-01-14T22:38:36.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43526 req_id = 6b16c566-475d-42d2-9db7-44075b87d098 response_code = 204 uri = /eip-gateways
25242025-01-14T22:38:36.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43526 req_id = b00a5998-51fc-4fa9-8c90-af15d98f96b3 response_code = 204 uri = /vpc-routes
25252025-01-14T22:38:36.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60853
25262025-01-14T22:38:36.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60853 req_id = 65a05f65-0bae-42fd-afb5-918b06189d42 response_code = 200 uri = /vpc-routes
25272025-01-14T22:38:36.428ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
25282025-01-14T22:38:36.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60853 req_id = 8be8afe2-f6c1-4925-a28e-be25de95b83c response_code = 204 uri = /eip-gateways
25292025-01-14T22:38:36.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60853 req_id = 72a5c17c-81fa-421e-a6e2-2170ccc58c46 response_code = 204 uri = /vpc-routes
25302025-01-14T22:38:36.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53054
25312025-01-14T22:38:36.508ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25322025-01-14T22:38:36.548ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25332025-01-14T22:38:36.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92746 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53054 req_id = a69d0dfc-86a8-4e29-90af-0d416b10f488 response_code = 204 uri = /switch-ports
25342025-01-14T22:38:36.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43239
25352025-01-14T22:38:36.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49169
25362025-01-14T22:38:36.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49169 req_id = c1a51a38-7bd5-42fc-923e-ead3d4b07880 response_code = 200 uri = /v2p
25372025-01-14T22:38:36.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53054 req_id = 48b82ee0-68f1-431f-864b-9c2cefbb661b response_code = 200 uri = /network-bootstore-config
25382025-01-14T22:38:36.601ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25392025-01-14T22:38:36.640ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25402025-01-14T22:38:36.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95343 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43239 req_id = b1e597b4-585f-49cb-834e-4e7a7b857e56 response_code = 204 uri = /switch-ports
25412025-01-14T22:38:36.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43239 req_id = 54253128-3901-45c1-8748-1cfb960633ac response_code = 200 uri = /network-bootstore-config
25422025-01-14T22:38:36.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63811
25432025-01-14T22:38:36.803ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25442025-01-14T22:38:36.839ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25452025-01-14T22:38:36.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94751 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63811 req_id = 68e21145-2d3c-457b-b3e5-8f50957ab9f9 response_code = 204 uri = /switch-ports
25462025-01-14T22:38:36.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63811 req_id = 65b6778c-0caf-4e4b-ad55-7493d8f3f5a3 response_code = 200 uri = /network-bootstore-config
25472025-01-14T22:38:56.321ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48235
25482025-01-14T22:38:56.321ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48235 req_id = 10b32f3c-7752-421b-8684-cce14c2b6097 response_code = 200 uri = /baseboard
25492025-01-14T22:39:04.018ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6978 local_addr = [fd00:1122:3344:101::1]:50816 method = GET remote_addr = [fd00:1122:3344:101::d]:55313 req_id = c07d118d-6193-40f6-914a-a571d41f1747 response_code = 200 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 uri = /652f7dd4-af0c-42f1-b515-fb2bf74375f9
25502025-01-14T22:39:06.088ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56240
25512025-01-14T22:39:06.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56240 req_id = c6134fb1-68fa-435b-8610-4205d92ec6d3 response_code = 200 uri = /vpc-routes
25522025-01-14T22:39:06.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59080
25532025-01-14T22:39:06.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59080 req_id = 001e315d-73f6-4cf1-8a0d-f97d5be324b2 response_code = 200 uri = /vpc-routes
25542025-01-14T22:39:06.156ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
25552025-01-14T22:39:06.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56240 req_id = 6e7f11ad-71f4-494f-b0d7-14649b6ed954 response_code = 204 uri = /eip-gateways
25562025-01-14T22:39:06.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 367 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56240 req_id = 5902e431-989d-4a9b-b741-eeb2d7d588ed response_code = 204 uri = /vpc-routes
25572025-01-14T22:39:06.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43195
25582025-01-14T22:39:06.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43195 req_id = 37684287-e0aa-448d-b62d-2561eb73e85f response_code = 200 uri = /v2p
25592025-01-14T22:39:06.179ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
25602025-01-14T22:39:06.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59080 req_id = 8a22bcbe-71b8-4970-9ece-5a6341409ac6 response_code = 204 uri = /eip-gateways
25612025-01-14T22:39:06.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 382 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59080 req_id = dbc47f50-771b-463f-ab50-f20c28d83838 response_code = 204 uri = /vpc-routes
25622025-01-14T22:39:06.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52612
25632025-01-14T22:39:06.201ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25642025-01-14T22:39:06.248ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25652025-01-14T22:39:06.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113637 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52612 req_id = 825292c8-c42f-47b2-be82-dca37ee47229 response_code = 204 uri = /switch-ports
25662025-01-14T22:39:06.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44885
25672025-01-14T22:39:06.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37169
25682025-01-14T22:39:06.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37169 req_id = 788ba691-ae25-4285-bceb-b1cf254c6dd6 response_code = 200 uri = /v2p
25692025-01-14T22:39:06.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52612 req_id = c539a450-4bd1-424f-b2d3-2be6d5b179e5 response_code = 200 uri = /network-bootstore-config
25702025-01-14T22:39:06.315ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25712025-01-14T22:39:06.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36115
25722025-01-14T22:39:06.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36115 req_id = c00f0ad9-135d-438b-8b68-8a6b520286d0 response_code = 200 uri = /vpc-routes
25732025-01-14T22:39:06.357ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25742025-01-14T22:39:06.364ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
25752025-01-14T22:39:06.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36115 req_id = 3b0f281d-943a-4d55-a684-5350ea21e08f response_code = 204 uri = /eip-gateways
25762025-01-14T22:39:06.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36115 req_id = 653136ee-4337-4b09-b84a-8cd0db7d3f90 response_code = 204 uri = /vpc-routes
25772025-01-14T22:39:06.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63135
25782025-01-14T22:39:06.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63135 req_id = 75d2c507-7af9-4806-9f32-6be2335e37d3 response_code = 200 uri = /v2p
25792025-01-14T22:39:06.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102469 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44885 req_id = 393f3c0c-1dc3-43fd-9822-866a1394a5d4 response_code = 204 uri = /switch-ports
25802025-01-14T22:39:06.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44885 req_id = b1bf8b55-c62e-42b6-a00b-27e0697c3e64 response_code = 200 uri = /network-bootstore-config
25812025-01-14T22:39:06.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52196
25822025-01-14T22:39:06.420ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25832025-01-14T22:39:06.455ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25842025-01-14T22:39:06.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93324 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52196 req_id = ae1e699d-4e4b-4a69-b54a-40cceb201286 response_code = 204 uri = /switch-ports
25852025-01-14T22:39:06.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52196 req_id = 41e4c401-3c2d-4596-b6a4-b84bb926113e response_code = 200 uri = /network-bootstore-config
25862025-01-14T22:39:26.356ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46180
25872025-01-14T22:39:26.356ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46180 req_id = b3817888-5477-457d-a43b-d02b3fe28772 response_code = 200 uri = /baseboard
25882025-01-14T22:39:34.018ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6408 local_addr = [fd00:1122:3344:101::1]:50816 method = GET remote_addr = [fd00:1122:3344:101::d]:55313 req_id = 4a677c1c-84a1-492d-a304-de7166f79748 response_code = 200 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 uri = /652f7dd4-af0c-42f1-b515-fb2bf74375f9
25892025-01-14T22:39:36.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39864
25902025-01-14T22:39:36.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39864 req_id = 14bf434e-83c5-4a33-99c2-b571db87dde0 response_code = 200 uri = /vpc-routes
25912025-01-14T22:39:36.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61628
25922025-01-14T22:39:36.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61628 req_id = c8be98c3-33dd-4119-a61b-d0a3d766bf5a response_code = 200 uri = /vpc-routes
25932025-01-14T22:39:36.297ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
25942025-01-14T22:39:36.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39864 req_id = ba1b8f63-6033-4bfa-8671-8e23fb2d89dd response_code = 204 uri = /eip-gateways
25952025-01-14T22:39:36.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39864 req_id = 6e3a2488-5130-401a-87aa-4d960a7566c2 response_code = 204 uri = /vpc-routes
25962025-01-14T22:39:36.330ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
25972025-01-14T22:39:36.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61628 req_id = b62a7e81-9852-4be3-80bf-2596cdb94270 response_code = 204 uri = /eip-gateways
25982025-01-14T22:39:36.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61628 req_id = 3e796e5b-e150-4f39-b2cb-0610d01b22b0 response_code = 204 uri = /vpc-routes
25992025-01-14T22:39:36.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33743
26002025-01-14T22:39:36.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33743 req_id = 491529e1-15a4-4b95-acd0-529210b7db8b response_code = 200 uri = /v2p
26012025-01-14T22:39:36.443ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56498
26022025-01-14T22:39:36.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56498 req_id = ee8dd692-9027-4a51-ae79-b7a3b51a7e67 response_code = 200 uri = /v2p
26032025-01-14T22:39:36.454ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57303
26042025-01-14T22:39:36.454ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26052025-01-14T22:39:36.491ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26062025-01-14T22:39:36.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94631 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57303 req_id = 435e42f0-e05f-42fb-9b58-08899d8fea94 response_code = 204 uri = /switch-ports
26072025-01-14T22:39:36.549ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63968
26082025-01-14T22:39:36.549ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45648
26092025-01-14T22:39:36.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63968 req_id = 5275dd14-2750-4d11-8da4-b5ba411f0de3 response_code = 200 uri = /vpc-routes
26102025-01-14T22:39:36.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57303 req_id = d5f91462-f6fb-4bf5-9851-f72200ed7f69 response_code = 200 uri = /network-bootstore-config
26112025-01-14T22:39:36.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45648 req_id = 7ac0710f-88ed-48de-b73c-5714975fefd7 response_code = 200 uri = /v2p
26122025-01-14T22:39:36.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41910
26132025-01-14T22:39:36.553ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26142025-01-14T22:39:36.597ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26152025-01-14T22:39:36.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105795 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41910 req_id = 2a88e08b-83b8-447c-ac17-2b28774fc23f response_code = 204 uri = /switch-ports
26162025-01-14T22:39:36.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33363
26172025-01-14T22:39:36.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 325 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41910 req_id = db5e3f6f-f610-46e1-ad55-124fd1652820 response_code = 200 uri = /network-bootstore-config
26182025-01-14T22:39:36.659ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26192025-01-14T22:39:36.659ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
26202025-01-14T22:39:36.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63968 req_id = 46b5b9b8-58ee-4ee2-aa94-b26daeb8d128 response_code = 204 uri = /eip-gateways
26212025-01-14T22:39:36.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 404 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63968 req_id = eb8b919e-f414-4984-8cde-61671aa3897a response_code = 204 uri = /vpc-routes
26222025-01-14T22:39:36.699ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26232025-01-14T22:39:36.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91128 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33363 req_id = a6f870be-abcb-4bde-a282-82136d53bd67 response_code = 204 uri = /switch-ports
26242025-01-14T22:39:36.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33363 req_id = 90472b56-c6ee-4d1c-9ef3-a962f3c78e12 response_code = 200 uri = /network-bootstore-config
26252025-01-14T22:39:56.390ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38485
26262025-01-14T22:39:56.390ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38485 req_id = 340895ac-0f57-4658-87c0-3b5fea37e6bc response_code = 200 uri = /baseboard
26272025-01-14T22:40:04.018ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6205 local_addr = [fd00:1122:3344:101::1]:50816 method = GET remote_addr = [fd00:1122:3344:101::d]:55313 req_id = 22a5cf65-2448-4cc0-a63d-e44c808aa956 response_code = 200 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 uri = /652f7dd4-af0c-42f1-b515-fb2bf74375f9
26282025-01-14T22:40:06.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54288
26292025-01-14T22:40:06.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54288 req_id = a104411d-85aa-40b7-936c-1e77c1840903 response_code = 200 uri = /vpc-routes
26302025-01-14T22:40:06.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59840
26312025-01-14T22:40:06.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59840 req_id = dd5bae8b-6f63-4ce1-9946-cea95d6f8f54 response_code = 200 uri = /vpc-routes
26322025-01-14T22:40:06.165ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
26332025-01-14T22:40:06.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59840 req_id = d0621cdc-67dc-4f38-809f-f2530aa8687a response_code = 204 uri = /eip-gateways
26342025-01-14T22:40:06.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 363 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59840 req_id = 54ad4816-9421-4f67-94e2-1af871ca4aa7 response_code = 204 uri = /vpc-routes
26352025-01-14T22:40:06.195ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
26362025-01-14T22:40:06.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54288 req_id = f74a9d94-c031-47a6-a500-88c53f3c6d4d response_code = 204 uri = /eip-gateways
26372025-01-14T22:40:06.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55309
26382025-01-14T22:40:06.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55309 req_id = 9c8b59bc-4bc2-4260-8ed8-cc01f9280792 response_code = 200 uri = /v2p
26392025-01-14T22:40:06.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54288 req_id = dc331380-689c-407b-aaa1-5d41c431f882 response_code = 204 uri = /vpc-routes
26402025-01-14T22:40:06.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36520
26412025-01-14T22:40:06.239ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26422025-01-14T22:40:06.281ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26432025-01-14T22:40:06.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103725 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36520 req_id = 56f227c3-ad41-4ce3-8138-abb0dc74d874 response_code = 204 uri = /switch-ports
26442025-01-14T22:40:06.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56361
26452025-01-14T22:40:06.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62759
26462025-01-14T22:40:06.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36520 req_id = 50ca4db6-2ac6-474c-958e-26b943ef9591 response_code = 200 uri = /network-bootstore-config
26472025-01-14T22:40:06.343ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26482025-01-14T22:40:06.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62759 req_id = 589c4621-9914-4180-89c4-252f95e98eab response_code = 200 uri = /vpc-routes
26492025-01-14T22:40:06.361ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
26502025-01-14T22:40:06.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 692 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62759 req_id = 4fe99316-fc6a-413f-9846-09f32fdefe7a response_code = 204 uri = /eip-gateways
26512025-01-14T22:40:06.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62759 req_id = 274027cd-4b1f-4469-b6d3-4c9137b7c548 response_code = 204 uri = /vpc-routes
26522025-01-14T22:40:06.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53184
26532025-01-14T22:40:06.384ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26542025-01-14T22:40:06.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36154
26552025-01-14T22:40:06.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36154 req_id = 760c49d3-54ca-4931-9d33-121bd75873dd response_code = 200 uri = /v2p
26562025-01-14T22:40:06.442ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26572025-01-14T22:40:06.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99438 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56361 req_id = 4f153716-6402-47e2-9636-fb5fc105be26 response_code = 204 uri = /switch-ports
26582025-01-14T22:40:06.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 685 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56361 req_id = 002d2bdf-76ae-4b0d-b4aa-680dd492e50b response_code = 200 uri = /network-bootstore-config
26592025-01-14T22:40:06.478ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26602025-01-14T22:40:06.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162200 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53184 req_id = 8c5bc8dc-c6a1-4b38-acf4-37152254170c response_code = 204 uri = /switch-ports
26612025-01-14T22:40:06.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53184 req_id = d25b1cae-8ad3-4c06-9a98-dd580ad11c66 response_code = 200 uri = /network-bootstore-config
26622025-01-14T22:40:06.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38331
26632025-01-14T22:40:06.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38331 req_id = 69017aa7-3761-4a12-a27d-ea206f925d89 response_code = 200 uri = /v2p
26642025-01-14T22:40:26.424ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43155
26652025-01-14T22:40:26.425ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43155 req_id = 83420618-bdf5-479a-9493-6d90f41d85ad response_code = 200 uri = /baseboard
26662025-01-14T22:40:34.019ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6712 local_addr = [fd00:1122:3344:101::1]:50816 method = GET remote_addr = [fd00:1122:3344:101::d]:55313 req_id = 650ed57d-183f-4ab3-b440-c044a25dadb9 response_code = 200 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 uri = /652f7dd4-af0c-42f1-b515-fb2bf74375f9
26672025-01-14T22:40:36.372ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44573
26682025-01-14T22:40:36.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44573 req_id = d1139e3c-ad98-4a3f-a2d9-092b420a0242 response_code = 200 uri = /vpc-routes
26692025-01-14T22:40:36.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50075
26702025-01-14T22:40:36.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50075 req_id = 5a349f0c-b70c-4bd4-8d7a-52fcd77108b9 response_code = 200 uri = /vpc-routes
26712025-01-14T22:40:36.429ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
26722025-01-14T22:40:36.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44573 req_id = 02ba52d2-1e9c-4ed4-99ba-41ee62f1f41f response_code = 204 uri = /eip-gateways
26732025-01-14T22:40:36.436ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
26742025-01-14T22:40:36.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50075 req_id = 281924d3-27ab-47b8-9ffb-e74fabe32d6c response_code = 204 uri = /eip-gateways
26752025-01-14T22:40:36.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34284
26762025-01-14T22:40:36.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34284 req_id = 4e18afbb-1ed3-4911-bfa7-0ebe78478170 response_code = 200 uri = /vpc-routes
26772025-01-14T22:40:36.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44573 req_id = dc35cba0-d0fa-4513-87ac-236f2bbec897 response_code = 204 uri = /vpc-routes
26782025-01-14T22:40:36.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50075 req_id = 68da10cc-82a3-4b39-adbf-7c7895a10514 response_code = 204 uri = /vpc-routes
26792025-01-14T22:40:36.460ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
26802025-01-14T22:40:36.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34284 req_id = 6f62c808-97f1-42e5-ae09-67453e07c68f response_code = 204 uri = /eip-gateways
26812025-01-14T22:40:36.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34284 req_id = bf0a62e4-2771-4323-808c-84ab12d749a7 response_code = 204 uri = /vpc-routes
26822025-01-14T22:40:36.477ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52557
26832025-01-14T22:40:36.477ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26842025-01-14T22:40:36.519ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26852025-01-14T22:40:36.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102753 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52557 req_id = a896174e-312c-43d8-a78a-c93e8027dead response_code = 204 uri = /switch-ports
26862025-01-14T22:40:36.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35380
26872025-01-14T22:40:36.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51935
26882025-01-14T22:40:36.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47126
26892025-01-14T22:40:36.580ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26902025-01-14T22:40:36.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3857 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51935 req_id = c24eb0d9-a2ad-4d3f-b37d-c08a995605b2 response_code = 200 uri = /v2p
26912025-01-14T22:40:36.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3975 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35380 req_id = 87b9af8e-ea4d-45b1-a38c-59b9b0b79990 response_code = 200 uri = /v2p
26922025-01-14T22:40:36.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3994 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52557 req_id = 27fcfb9c-d24f-44c7-8e56-7b2a86639aed response_code = 200 uri = /network-bootstore-config
26932025-01-14T22:40:36.616ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26942025-01-14T22:40:36.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46564
26952025-01-14T22:40:36.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46564 req_id = 5b1e3533-4024-4ae6-80ea-49a9394e3c0f response_code = 200 uri = /v2p
26962025-01-14T22:40:36.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92521 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47126 req_id = f60a936d-81a3-4007-b947-510009e52071 response_code = 204 uri = /switch-ports
26972025-01-14T22:40:36.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47126 req_id = 54d27525-10d8-45d5-b48a-dc379f77a956 response_code = 200 uri = /network-bootstore-config
26982025-01-14T22:40:36.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60120
26992025-01-14T22:40:36.683ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27002025-01-14T22:40:36.720ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27012025-01-14T22:40:36.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92556 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60120 req_id = b148bd1b-3e20-448c-8bbd-af0fce4c5f99 response_code = 204 uri = /switch-ports
27022025-01-14T22:40:36.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60120 req_id = 38526d37-59ef-4acc-a6c6-1eaa49c8ea20 response_code = 200 uri = /network-bootstore-config
27032025-01-14T22:40:56.459ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44864
27042025-01-14T22:40:56.459ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44864 req_id = 12780df4-8107-47af-943e-d8c5460e48ef response_code = 200 uri = /baseboard
27052025-01-14T22:41:04.020ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6409 local_addr = [fd00:1122:3344:101::1]:50816 method = GET remote_addr = [fd00:1122:3344:101::d]:55313 req_id = 28b7100c-2380-4b29-9502-e649d0065ed6 response_code = 200 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 uri = /652f7dd4-af0c-42f1-b515-fb2bf74375f9
27062025-01-14T22:41:06.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45357
27072025-01-14T22:41:06.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45357 req_id = 15a7a8c0-560b-4815-86d9-59e12afe04e7 response_code = 200 uri = /vpc-routes
27082025-01-14T22:41:06.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54167
27092025-01-14T22:41:06.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 19 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54167 req_id = 919cf142-8ea5-4220-8e2f-ebaf538e5498 response_code = 200 uri = /vpc-routes
27102025-01-14T22:41:06.122ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
27112025-01-14T22:41:06.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45357 req_id = 6cda9136-2ed2-4a8e-a792-ec76da5bc89f response_code = 204 uri = /eip-gateways
27122025-01-14T22:41:06.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 408 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45357 req_id = 10e8fbe3-6609-4d4a-a0ef-83c4cc4cdd32 response_code = 204 uri = /vpc-routes
27132025-01-14T22:41:06.171ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
27142025-01-14T22:41:06.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54167 req_id = b39b1b69-29c8-4225-b5bb-6c639571e9b0 response_code = 204 uri = /eip-gateways
27152025-01-14T22:41:06.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54167 req_id = db215ed3-1ec5-4206-8cfd-7266fa4034eb response_code = 204 uri = /vpc-routes
27162025-01-14T22:41:06.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34654
27172025-01-14T22:41:06.218ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27182025-01-14T22:41:06.259ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27192025-01-14T22:41:06.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94274 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34654 req_id = de127654-a884-4750-ab27-8e63f7908ecf response_code = 204 uri = /switch-ports
27202025-01-14T22:41:06.313ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44240
27212025-01-14T22:41:06.313ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57963
27222025-01-14T22:41:06.313ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53313
27232025-01-14T22:41:06.313ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27242025-01-14T22:41:06.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3761 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57963 req_id = 4af23492-3403-4d15-935d-eefdf2f0db33 response_code = 200 uri = /v2p
27252025-01-14T22:41:06.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3851 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44240 req_id = fa2f4816-63f6-4598-895d-48f487dfa505 response_code = 200 uri = /v2p
27262025-01-14T22:41:06.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3910 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34654 req_id = 79a3660d-aa94-4f51-8acf-489d58942cb9 response_code = 200 uri = /network-bootstore-config
27272025-01-14T22:41:06.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53979
27282025-01-14T22:41:06.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53979 req_id = 3ed7e61c-ce7f-4f1c-b0db-19482e35bca0 response_code = 200 uri = /vpc-routes
27292025-01-14T22:41:06.349ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27302025-01-14T22:41:06.368ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
27312025-01-14T22:41:06.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53979 req_id = c2f15d36-1ac7-4e6b-85a2-266b6575562b response_code = 204 uri = /eip-gateways
27322025-01-14T22:41:06.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41050
27332025-01-14T22:41:06.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41050 req_id = aed735e3-4181-46f0-9ab6-1363094cda97 response_code = 200 uri = /v2p
27342025-01-14T22:41:06.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53979 req_id = a4a7a0f4-36d8-485f-be0c-51e467a2059a response_code = 204 uri = /vpc-routes
27352025-01-14T22:41:06.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92385 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53313 req_id = 2afe2673-4707-439f-8959-a5b78e857315 response_code = 204 uri = /switch-ports
27362025-01-14T22:41:06.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53313 req_id = 087e0681-ed4c-47fe-a2da-3a782efd6781 response_code = 200 uri = /network-bootstore-config
27372025-01-14T22:41:06.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50850
27382025-01-14T22:41:06.473ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27392025-01-14T22:41:06.507ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27402025-01-14T22:41:06.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84694 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50850 req_id = 58f3cb0a-244d-408c-ad5f-0bc5bff74481 response_code = 204 uri = /switch-ports
27412025-01-14T22:41:06.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50850 req_id = 7c6591e7-83c1-46d7-b8d9-8bd741d451e6 response_code = 200 uri = /network-bootstore-config
27422025-01-14T22:41:26.495ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65006
27432025-01-14T22:41:26.495ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65006 req_id = 227837b2-e832-48c0-bc0c-489262a34ada response_code = 200 uri = /baseboard
27442025-01-14T22:41:34.019ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5557 local_addr = [fd00:1122:3344:101::1]:50816 method = GET remote_addr = [fd00:1122:3344:101::d]:55313 req_id = c43ea777-890a-4ee2-a498-3b730ab89409 response_code = 200 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 uri = /652f7dd4-af0c-42f1-b515-fb2bf74375f9
27452025-01-14T22:41:36.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57569
27462025-01-14T22:41:36.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57569 req_id = c1c2f4b9-d40e-4252-aade-67f9c518ad9e response_code = 200 uri = /vpc-routes
27472025-01-14T22:41:36.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41645
27482025-01-14T22:41:36.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41645 req_id = 9b0290d9-43f3-4d83-91c3-191913d65843 response_code = 200 uri = /v2p
27492025-01-14T22:41:36.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37231
27502025-01-14T22:41:36.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37231 req_id = b3087191-400f-4b69-aae7-bdfab4301b60 response_code = 200 uri = /v2p
27512025-01-14T22:41:36.362ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64240
27522025-01-14T22:41:36.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64240 req_id = 99677b26-57d6-4198-9986-d602390b8772 response_code = 200 uri = /vpc-routes
27532025-01-14T22:41:36.370ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
27542025-01-14T22:41:36.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57569 req_id = 57fc4a85-e9ec-48c5-b85b-67dc529c4b2b response_code = 204 uri = /eip-gateways
27552025-01-14T22:41:36.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 527 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57569 req_id = 9710e117-cc22-4fd4-a331-7a533dcb1bd1 response_code = 204 uri = /vpc-routes
27562025-01-14T22:41:36.475ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
27572025-01-14T22:41:36.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64240 req_id = 5b5efec1-be89-4ce8-8843-4e7d830dcde4 response_code = 204 uri = /eip-gateways
27582025-01-14T22:41:36.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64240 req_id = af63f45c-4275-4e82-8826-33eb03516816 response_code = 204 uri = /vpc-routes
27592025-01-14T22:41:36.515ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43515
27602025-01-14T22:41:36.515ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27612025-01-14T22:41:36.571ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27622025-01-14T22:41:36.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145545 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43515 req_id = a67e9c53-fdb6-4bf1-aabc-60832b665292 response_code = 204 uri = /switch-ports
27632025-01-14T22:41:36.661ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56414
27642025-01-14T22:41:36.661ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35503
27652025-01-14T22:41:36.661ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56300
27662025-01-14T22:41:36.661ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33733
27672025-01-14T22:41:36.661ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58870
27682025-01-14T22:41:36.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 386 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43515 req_id = 0975317c-d5eb-404b-822e-3971c092f7a0 response_code = 200 uri = /network-bootstore-config
27692025-01-14T22:41:36.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56414 req_id = 7c49dbd2-2458-4f02-9976-41cd127bc4b1 response_code = 200 uri = /vpc-routes
27702025-01-14T22:41:36.662ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27712025-01-14T22:41:36.662ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27722025-01-14T22:41:36.662ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27732025-01-14T22:41:36.662ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27742025-01-14T22:41:36.662ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/omicron-zones.json file = common/src/ledger.rs:177
27752025-01-14T22:41:36.662ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 08ab3e6f-8169-4727-9bfd-8dd0f022af2c, kind: Service { id: a66dcc60-1225-4e39-ab1a-b70caf5209e9 }, name: Name("external-dns-a66dcc60-1225-4e39-ab1a-b70caf5209e9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd47cf7f-251c-4290-8688-7e2060f2050c, kind: Service { id: 696becfd-808e-490f-8687-0b1b89035dda }, name: Name("external-dns-696becfd-808e-490f-8687-0b1b89035dda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 187])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0db76917-acaf-4b6b-8dbb-d22b559cd940, kind: Service { id: e1b2ab23-7976-4ea8-a2a7-c53e015d5764 }, name: Name("nexus-e1b2ab23-7976-4ea8-a2a7-c53e015d5764"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 922e49e1-e5c9-4471-b22f-5e46cae983ea, kind: Service { id: 3203df94-bda8-401f-99df-30e90a5f076d }, name: Name("nexus-3203df94-bda8-401f-99df-30e90a5f076d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9ca98b6d-c3b4-4bfe-a1f8-0d99a0a5ce6f, kind: Service { id: b0506d4d-8223-4315-9fa0-31e028a676f3 }, name: Name("nexus-b0506d4d-8223-4315-9fa0-31e028a676f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27762025-01-14T22:41:36.662ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27772025-01-14T22:41:36.663ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27782025-01-14T22:41:36.673ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27792025-01-14T22:41:36.673ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27802025-01-14T22:41:36.673ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27812025-01-14T22:41:36.673ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27822025-01-14T22:41:36.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11611 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58870 req_id = d9e99df9-ce78-4720-b86f-61ba3c103353 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27832025-01-14T22:41:36.673ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/omicron-zones.json file = common/src/ledger.rs:177
27842025-01-14T22:41:36.698ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27852025-01-14T22:41:36.698ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8
27862025-01-14T22:41:36.721ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27872025-01-14T22:41:36.721ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/omicron-zones.json file = common/src/ledger.rs:177
27882025-01-14T22:41:36.725ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27892025-01-14T22:41:36.732ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
27902025-01-14T22:41:36.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6654 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56414 req_id = 50527d56-11cf-4dde-9ca4-755127ace336 response_code = 204 uri = /eip-gateways
27912025-01-14T22:41:36.733ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/omicron-zones.json file = common/src/ledger.rs:177
27922025-01-14T22:41:36.740ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27932025-01-14T22:41:36.740ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_17026a0f-546c-4e8b-87e1-2bef866e5f38
27942025-01-14T22:41:36.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6995 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56414 req_id = 71f145d7-bd81-4645-9a61-520ccdad9a79 response_code = 204 uri = /vpc-routes
27952025-01-14T22:41:36.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56166
27962025-01-14T22:41:36.761ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27972025-01-14T22:41:36.762ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8
27982025-01-14T22:41:36.781ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27992025-01-14T22:41:36.781ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28002025-01-14T22:41:36.781ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/config/omicron-zones.json file = common/src/ledger.rs:177
28012025-01-14T22:41:36.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42395
28022025-01-14T22:41:36.800ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28032025-01-14T22:41:36.800ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_193d38c2-fbe5-4b1d-95c5-92a256ddffe2
28042025-01-14T22:41:36.801ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/config/omicron-zones.json file = common/src/ledger.rs:177
28052025-01-14T22:41:36.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6632 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42395 req_id = 214ea078-c809-4f7a-94f6-a1f98fa6c0ef response_code = 200 uri = /v2p
28062025-01-14T22:41:36.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35897
28072025-01-14T22:41:36.823ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28082025-01-14T22:41:36.823ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_17026a0f-546c-4e8b-87e1-2bef866e5f38
28092025-01-14T22:41:36.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59324
28102025-01-14T22:41:36.832ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 08ab3e6f-8169-4727-9bfd-8dd0f022af2c, kind: Service { id: a66dcc60-1225-4e39-ab1a-b70caf5209e9 }, name: Name("external-dns-a66dcc60-1225-4e39-ab1a-b70caf5209e9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd47cf7f-251c-4290-8688-7e2060f2050c, kind: Service { id: 696becfd-808e-490f-8687-0b1b89035dda }, name: Name("external-dns-696becfd-808e-490f-8687-0b1b89035dda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 187])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0db76917-acaf-4b6b-8dbb-d22b559cd940, kind: Service { id: e1b2ab23-7976-4ea8-a2a7-c53e015d5764 }, name: Name("nexus-e1b2ab23-7976-4ea8-a2a7-c53e015d5764"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 922e49e1-e5c9-4471-b22f-5e46cae983ea, kind: Service { id: 3203df94-bda8-401f-99df-30e90a5f076d }, name: Name("nexus-3203df94-bda8-401f-99df-30e90a5f076d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9ca98b6d-c3b4-4bfe-a1f8-0d99a0a5ce6f, kind: Service { id: b0506d4d-8223-4315-9fa0-31e028a676f3 }, name: Name("nexus-b0506d4d-8223-4315-9fa0-31e028a676f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28112025-01-14T22:41:36.833ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28122025-01-14T22:41:36.833ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28132025-01-14T22:41:36.833ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28142025-01-14T22:41:36.833ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28152025-01-14T22:41:36.833ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28162025-01-14T22:41:36.833ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28172025-01-14T22:41:36.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 639 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59324 req_id = 3dcaf1fc-ea58-4997-9ca8-e790e8334245 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28182025-01-14T22:41:36.836ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28192025-01-14T22:41:36.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174103 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35503 req_id = 3e9dd768-7a63-4135-a3ae-d8ae31ab770d response_code = 204 uri = /switch-ports
28202025-01-14T22:41:36.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1086 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35503 req_id = 58e80997-b2cc-46e7-aa69-3a4a5d026567 response_code = 200 uri = /network-bootstore-config
28212025-01-14T22:41:36.843ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28222025-01-14T22:41:36.843ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8
28232025-01-14T22:41:36.864ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28242025-01-14T22:41:36.864ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f72d9943-3b41-40fd-968b-8debb9d0e66b
28252025-01-14T22:41:36.880ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 17026a0f-546c-4e8b-87e1-2bef866e5f38 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28262025-01-14T22:41:36.880ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_17026a0f-546c-4e8b-87e1-2bef866e5f38
28272025-01-14T22:41:36.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35283
28282025-01-14T22:41:36.888ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 08ab3e6f-8169-4727-9bfd-8dd0f022af2c, kind: Service { id: a66dcc60-1225-4e39-ab1a-b70caf5209e9 }, name: Name("external-dns-a66dcc60-1225-4e39-ab1a-b70caf5209e9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd47cf7f-251c-4290-8688-7e2060f2050c, kind: Service { id: 696becfd-808e-490f-8687-0b1b89035dda }, name: Name("external-dns-696becfd-808e-490f-8687-0b1b89035dda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 187])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0db76917-acaf-4b6b-8dbb-d22b559cd940, kind: Service { id: e1b2ab23-7976-4ea8-a2a7-c53e015d5764 }, name: Name("nexus-e1b2ab23-7976-4ea8-a2a7-c53e015d5764"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 922e49e1-e5c9-4471-b22f-5e46cae983ea, kind: Service { id: 3203df94-bda8-401f-99df-30e90a5f076d }, name: Name("nexus-3203df94-bda8-401f-99df-30e90a5f076d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9ca98b6d-c3b4-4bfe-a1f8-0d99a0a5ce6f, kind: Service { id: b0506d4d-8223-4315-9fa0-31e028a676f3 }, name: Name("nexus-b0506d4d-8223-4315-9fa0-31e028a676f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 101])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28292025-01-14T22:41:36.888ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28302025-01-14T22:41:36.888ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28312025-01-14T22:41:36.888ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28322025-01-14T22:41:36.888ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28332025-01-14T22:41:36.888ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28342025-01-14T22:41:36.888ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28352025-01-14T22:41:36.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 428 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35283 req_id = e6405263-b28a-4092-bc38-2517f803499b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28362025-01-14T22:41:36.889ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28372025-01-14T22:41:36.896ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28382025-01-14T22:41:36.896ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_193d38c2-fbe5-4b1d-95c5-92a256ddffe2
28392025-01-14T22:41:36.913ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28402025-01-14T22:41:36.914ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ebeecaa7-8727-491c-81b6-8ff8177ba2c6
28412025-01-14T22:41:36.929ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28422025-01-14T22:41:36.929ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f72d9943-3b41-40fd-968b-8debb9d0e66b
28432025-01-14T22:41:36.944ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 193d38c2-fbe5-4b1d-95c5-92a256ddffe2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28442025-01-14T22:41:36.944ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_193d38c2-fbe5-4b1d-95c5-92a256ddffe2
28452025-01-14T22:41:36.966ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28462025-01-14T22:41:36.966ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_489724fa-785f-4f35-bb0f-34adf6a09482
28472025-01-14T22:41:36.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151095 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35897 req_id = c32f3665-5fa9-4d03-a605-b1bf6b5555a2 response_code = 204 uri = /switch-ports
28482025-01-14T22:41:36.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 688 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35897 req_id = 8c388c98-9c28-427e-aedb-22265f33f10f response_code = 200 uri = /network-bootstore-config
28492025-01-14T22:41:36.982ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f72d9943-3b41-40fd-968b-8debb9d0e66b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28502025-01-14T22:41:36.982ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f72d9943-3b41-40fd-968b-8debb9d0e66b
28512025-01-14T22:41:36.995ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28522025-01-14T22:41:36.995ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ebeecaa7-8727-491c-81b6-8ff8177ba2c6
28532025-01-14T22:41:37.012ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a77abd92-fef1-4271-b3d6-7b70ec3d579b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28542025-01-14T22:41:37.012ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a77abd92-fef1-4271-b3d6-7b70ec3d579b
28552025-01-14T22:41:37.032ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28562025-01-14T22:41:37.032ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_489724fa-785f-4f35-bb0f-34adf6a09482
28572025-01-14T22:41:37.044ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ebeecaa7-8727-491c-81b6-8ff8177ba2c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28582025-01-14T22:41:37.044ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ebeecaa7-8727-491c-81b6-8ff8177ba2c6
28592025-01-14T22:41:37.062ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28602025-01-14T22:41:37.062ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59
28612025-01-14T22:41:37.081ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 489724fa-785f-4f35-bb0f-34adf6a09482 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28622025-01-14T22:41:37.081ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_489724fa-785f-4f35-bb0f-34adf6a09482
28632025-01-14T22:41:37.094ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a77abd92-fef1-4271-b3d6-7b70ec3d579b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28642025-01-14T22:41:37.094ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a77abd92-fef1-4271-b3d6-7b70ec3d579b
28652025-01-14T22:41:37.111ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28662025-01-14T22:41:37.111ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_42c887d6-10d1-4b8b-a7bb-82239cc2998c
28672025-01-14T22:41:37.127ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28682025-01-14T22:41:37.127ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59
28692025-01-14T22:41:37.140ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a77abd92-fef1-4271-b3d6-7b70ec3d579b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28702025-01-14T22:41:37.140ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a77abd92-fef1-4271-b3d6-7b70ec3d579b
28712025-01-14T22:41:37.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 482450 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56300 req_id = f14fe10e-6b72-4a15-9113-a622695acbb4 response_code = 200 uri = /inventory
28722025-01-14T22:41:37.164ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28732025-01-14T22:41:37.164ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59
28742025-01-14T22:41:37.176ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28752025-01-14T22:41:37.176ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_42c887d6-10d1-4b8b-a7bb-82239cc2998c
28762025-01-14T22:41:37.194ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 42c887d6-10d1-4b8b-a7bb-82239cc2998c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28772025-01-14T22:41:37.194ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_42c887d6-10d1-4b8b-a7bb-82239cc2998c
28782025-01-14T22:41:37.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 536946 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33733 req_id = 526d1643-922b-4cbc-b87d-937825a87f38 response_code = 200 uri = /inventory
28792025-01-14T22:41:37.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 452687 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56166 req_id = 220a03bc-9e40-4e48-971a-ca2d0ab5dbda response_code = 200 uri = /inventory
28802025-01-14T22:41:48.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47900
28812025-01-14T22:41:48.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47900 req_id = e1c5fae8-66ca-4d1d-a474-afc667662163 response_code = 200 uri = /v2p
28822025-01-14T22:41:48.332ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(15254830) }
28832025-01-14T22:41:48.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1603 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47900 req_id = 2b8034ac-2f06-458a-8c76-363561daee1b response_code = 204 uri = /v2p
28842025-01-14T22:41:48.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65060
28852025-01-14T22:41:48.504ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 1d51a386-d2a6-4903-a8ec-2c4496988a60, kind: Instance { id: 0db897ff-2a3c-4240-9e17-233297a4786a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15254830), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1d51a386-d2a6-4903-a8ec-2c4496988a60, kind: Instance { id: 0db897ff-2a3c-4240-9e17-233297a4786a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15254830), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1d51a386-d2a6-4903-a8ec-2c4496988a60, kind: Instance { id: 0db897ff-2a3c-4240-9e17-233297a4786a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15254830), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(15254830))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1d51a386-d2a6-4903-a8ec-2c4496988a60, kind: Instance { id: 0db897ff-2a3c-4240-9e17-233297a4786a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15254830), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 99dad0fc-7e22-4f11-867f-5fca59a82729, slot: 0, read_only: false, vcr_json: .., name: "disk-8164950fded" }], boot_settings: Some(InstanceBootSettings { order: [99dad0fc-7e22-4f11-867f-5fca59a82729] }), cloud_init_bytes: Some(..) } instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a metadata = InstanceMetadata { silo_id: 7062a1ca-611f-417e-9614-a98166528f5f, project_id: 6b8c52d3-1213-43b9-9ada-bc76aec2ce1f } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-14T22:41:48.499457954Z }
28862025-01-14T22:41:48.504ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a migration_id = None propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
28872025-01-14T22:41:48.504ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1562 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a migration_id = None propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 1d51a386-d2a6-4903-a8ec-2c4496988a60, kind: Instance { id: 0db897ff-2a3c-4240-9e17-233297a4786a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15254830), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1d51a386-d2a6-4903-a8ec-2c4496988a60, kind: Instance { id: 0db897ff-2a3c-4240-9e17-233297a4786a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15254830), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1d51a386-d2a6-4903-a8ec-2c4496988a60, kind: Instance { id: 0db897ff-2a3c-4240-9e17-233297a4786a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15254830), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(15254830))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1d51a386-d2a6-4903-a8ec-2c4496988a60, kind: Instance { id: 0db897ff-2a3c-4240-9e17-233297a4786a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15254830), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 99dad0fc-7e22-4f11-867f-5fca59a82729, slot: 0, read_only: false, vcr_json: .., name: "disk-8164950fded" }], boot_settings: Some(InstanceBootSettings { order: [99dad0fc-7e22-4f11-867f-5fca59a82729] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-14T22:41:48.499457954Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
28882025-01-14T22:41:48.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65060 req_id = b92c0360-3fe2-46d0-a698-ad9ae171c8c7 response_code = 200 uri = /vmms/255c0a6f-b76b-4bc5-b82d-f867181007de
28892025-01-14T22:41:48.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51345
28902025-01-14T22:41:48.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1509 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51345 req_id = 650be3eb-12cf-41e2-a61a-d58ff95d8922 response_code = 200 uri = /vmms/255c0a6f-b76b-4bc5-b82d-f867181007de/state
28912025-01-14T22:41:48.610ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 15254830 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
28922025-01-14T22:41:48.610ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28932025-01-14T22:41:48.649ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de file = illumos-utils/src/zone.rs:325 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
28942025-01-14T22:41:48.671ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de file = illumos-utils/src/zone.rs:363 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
28952025-01-14T22:41:48.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55763
28962025-01-14T22:41:48.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55763 req_id = 9d9f679b-1d2c-4aaa-a9bf-31a5607e1296 response_code = 200 uri = /vpc-routes
28972025-01-14T22:41:48.709ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {1d51a386-d2a6-4903-a8ec-2c4496988a60: {10.151.1.175: {b35180cd-43ae-4e39-b2c2-831b0706fe3b}, 10.151.1.176: {b35180cd-43ae-4e39-b2c2-831b0706fe3b}}} }
28982025-01-14T22:41:50.235ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
28992025-01-14T22:41:50.235ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de zone file = illumos-utils/src/running_zone.rs:488 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de zone = oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de
29002025-01-14T22:41:50.410ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de") failed: Property not found. retry in 51.663355ms file = illumos-utils/src/svc.rs:36 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de zone = oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de
29012025-01-14T22:41:50.470ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de") failed: Property not found. retry in 102.899073ms file = illumos-utils/src/svc.rs:36 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de zone = oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de
29022025-01-14T22:41:50.602ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de") failed: Property not found. retry in 297.733258ms file = illumos-utils/src/svc.rs:36 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de zone = oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de
29032025-01-14T22:41:50.920ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de") failed: Property not found. retry in 464.053832ms file = illumos-utils/src/svc.rs:36 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de zone = oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de
29042025-01-14T22:41:51.395ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de") failed: Property not found. retry in 865.288198ms file = illumos-utils/src/svc.rs:36 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de zone = oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de
29052025-01-14T22:41:52.272ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de") failed: Property not found. retry in 886.145769ms file = illumos-utils/src/svc.rs:36 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de zone = oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de
29062025-01-14T22:41:53.169ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de") failed: Property not found. retry in 1.231864459s file = illumos-utils/src/svc.rs:36 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de zone = oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de
29072025-01-14T22:41:54.412ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de") failed: Property not found. retry in 728.660238ms file = illumos-utils/src/svc.rs:36 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de zone = oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de
29082025-01-14T22:41:55.169ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de file = sled-agent/src/instance.rs:2067 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
29092025-01-14T22:41:55.178ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de") failed: Property not found. retry in 71.31961ms file = illumos-utils/src/svc.rs:36 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
29102025-01-14T22:41:55.260ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de") failed: Property not found. retry in 141.15944ms file = illumos-utils/src/svc.rs:36 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
29112025-01-14T22:41:55.413ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de") failed: Property not found. retry in 198.809216ms file = illumos-utils/src/svc.rs:36 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
29122025-01-14T22:41:55.623ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de") failed: Property not found. retry in 325.423073ms file = illumos-utils/src/svc.rs:36 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
29132025-01-14T22:41:55.963ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2076 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
29142025-01-14T22:41:56.001ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2100 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
29152025-01-14T22:41:56.145ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1213 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
29162025-01-14T22:41:56.146ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-01-14T22:41:56.146472855Z } file = sled-agent/src/instance.rs:780 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
29172025-01-14T22:41:56.146ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-14T22:41:56.146472855Z } propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
29182025-01-14T22:41:56.146ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-14T22:41:56.146472855Z }, migration_in: None, migration_out: None }
29192025-01-14T22:41:56.146ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
29202025-01-14T22:41:56.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7437251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55763 req_id = c7835db1-cd14-45a6-956a-12f6bd23878d response_code = 204 uri = /eip-gateways
29212025-01-14T22:41:56.180ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-01-14T22:41:56.179998326Z } file = sled-agent/src/instance.rs:780 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
29222025-01-14T22:41:56.180ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-14T22:41:56.179998326Z } propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
29232025-01-14T22:41:56.180ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-14T22:41:56.179998326Z }, migration_in: None, migration_out: None }
29242025-01-14T22:41:56.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 500 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55763 req_id = b9ccaaa6-5c15-474f-8be2-063ccc422870 response_code = 204 uri = /vpc-routes
29252025-01-14T22:41:56.530ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42012
29262025-01-14T22:41:56.530ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42012 req_id = 61837984-426c-47c8-9db2-872ec2e82155 response_code = 200 uri = /baseboard
29272025-01-14T22:42:04.019ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5381 local_addr = [fd00:1122:3344:101::1]:50816 method = GET remote_addr = [fd00:1122:3344:101::d]:55313 req_id = 636db4f1-eeb4-48f5-a273-98bff5b82fd7 response_code = 200 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 uri = /652f7dd4-af0c-42f1-b515-fb2bf74375f9
29282025-01-14T22:42:05.997ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46175
29292025-01-14T22:42:05.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46175 req_id = 38a3e147-ee2c-4e8d-ad88-e892f3debf45 response_code = 200 uri = /vmms/255c0a6f-b76b-4bc5-b82d-f867181007de/state
29302025-01-14T22:42:06.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64776
29312025-01-14T22:42:06.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64776 req_id = a4dae04f-51d8-469d-a20c-cf0b8d3fa060 response_code = 200 uri = /vpc-routes
29322025-01-14T22:42:06.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52986
29332025-01-14T22:42:06.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52986 req_id = 7a03f6c7-581f-4b5d-a6a5-da3d381b0e97 response_code = 200 uri = /vpc-routes
29342025-01-14T22:42:06.159ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {1d51a386-d2a6-4903-a8ec-2c4496988a60: {10.151.1.176: {b35180cd-43ae-4e39-b2c2-831b0706fe3b}, 10.151.1.175: {b35180cd-43ae-4e39-b2c2-831b0706fe3b}}} }
29352025-01-14T22:42:06.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64776 req_id = 85d7970e-2ad7-4fce-b8a4-655f999a6529 response_code = 204 uri = /eip-gateways
29362025-01-14T22:42:06.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57461
29372025-01-14T22:42:06.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57461 req_id = c44bad57-b1e9-4b9f-91cc-ec9c3ed8b015 response_code = 200 uri = /vmms/255c0a6f-b76b-4bc5-b82d-f867181007de/state
29382025-01-14T22:42:06.180ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {1d51a386-d2a6-4903-a8ec-2c4496988a60: {10.151.1.175: {b35180cd-43ae-4e39-b2c2-831b0706fe3b}, 10.151.1.176: {b35180cd-43ae-4e39-b2c2-831b0706fe3b}}} }
29392025-01-14T22:42:06.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52986 req_id = 884b68f2-1d8c-4ae6-a47f-6d11f37691b5 response_code = 204 uri = /eip-gateways
29402025-01-14T22:42:06.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52986 req_id = 7dd76940-91e3-433f-87c4-ee2f45a94871 response_code = 204 uri = /vpc-routes
29412025-01-14T22:42:06.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47167
29422025-01-14T22:42:06.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47167 req_id = 5f181a9a-2961-45bb-86a1-8b72d8fc6a9e response_code = 200 uri = /v2p
29432025-01-14T22:42:06.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57595
29442025-01-14T22:42:06.270ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
29452025-01-14T22:42:06.316ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
29462025-01-14T22:42:06.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107892 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57595 req_id = ae284fee-f7ef-49dd-aed1-2738fbb79132 response_code = 204 uri = /switch-ports
29472025-01-14T22:42:06.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44774
29482025-01-14T22:42:06.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52074
29492025-01-14T22:42:06.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54916
29502025-01-14T22:42:06.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55145
29512025-01-14T22:42:06.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44441
29522025-01-14T22:42:06.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44774 req_id = ee0664fd-02fd-4d55-bd5e-a3024ec59043 response_code = 200 uri = /v2p
29532025-01-14T22:42:06.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 403 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57595 req_id = d1a81291-0dcf-4dc9-859c-2e4626a2a2a8 response_code = 200 uri = /network-bootstore-config
29542025-01-14T22:42:06.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 359 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52074 req_id = 48b041c8-297b-486f-9907-e8f0aadf7ddd response_code = 200 uri = /vmms/255c0a6f-b76b-4bc5-b82d-f867181007de/state
29552025-01-14T22:42:06.379ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
29562025-01-14T22:42:06.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 667 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64776 req_id = 020b83ee-a503-4134-9ebf-42818d928190 response_code = 204 uri = /vpc-routes
29572025-01-14T22:42:06.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 335 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54916 req_id = 29e54d43-e0a6-4ef2-aff0-71e28e9bb7dd response_code = 200 uri = /vpc-routes
29582025-01-14T22:42:06.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44441 req_id = 296e9567-c2c9-4c0e-83c2-9e4b620114eb response_code = 200 uri = /v2p
29592025-01-14T22:42:06.397ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {1d51a386-d2a6-4903-a8ec-2c4496988a60: {10.151.1.175: {b35180cd-43ae-4e39-b2c2-831b0706fe3b}, 10.151.1.176: {b35180cd-43ae-4e39-b2c2-831b0706fe3b}}} }
29602025-01-14T22:42:06.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 616 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54916 req_id = 197611b4-ad57-4050-96ed-0379adc54853 response_code = 204 uri = /eip-gateways
29612025-01-14T22:42:06.397ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50794
29622025-01-14T22:42:06.419ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
29632025-01-14T22:42:06.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48776
29642025-01-14T22:42:06.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 557 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48776 req_id = f3256350-1572-4493-945d-939a817932fb response_code = 200 uri = /vmms/255c0a6f-b76b-4bc5-b82d-f867181007de/state
29652025-01-14T22:42:06.424ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-01-14T22:42:06.424876905Z } file = sled-agent/src/instance.rs:780 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
29662025-01-14T22:42:06.424ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-14T22:42:06.424876905Z } propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
29672025-01-14T22:42:06.424ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-14T22:42:06.424876905Z }, migration_in: None, migration_out: None }
29682025-01-14T22:42:06.436ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-01-14T22:42:06.436489594Z } file = sled-agent/src/instance.rs:780 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
29692025-01-14T22:42:06.436ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-14T22:42:06.436489594Z } propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
29702025-01-14T22:42:06.436ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
29712025-01-14T22:42:06.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1531 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54916 req_id = 34c140b1-aa4c-49c0-ba86-9c27add6540b response_code = 204 uri = /vpc-routes
29722025-01-14T22:42:06.436ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29732025-01-14T22:42:06.437ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 4433547924076313620 n_samples = 6 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
29742025-01-14T22:42:06.437ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29752025-01-14T22:42:06.437ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/ecf20bd2-553d-4a86-bee6-6b66419f2aa7/debug/bundle/zone", "/pool/int/f8623b78-d620-46da-9ac6-8ccbfd340e73/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/dcbe76a8-1ca2-4922-889a-72ea3ee9c1d8/crypt/debug", "/pool/ext/17026a0f-546c-4e8b-87e1-2bef866e5f38/crypt/debug", "/pool/ext/193d38c2-fbe5-4b1d-95c5-92a256ddffe2/crypt/debug", "/pool/ext/f72d9943-3b41-40fd-968b-8debb9d0e66b/crypt/debug", "/pool/ext/ebeecaa7-8727-491c-81b6-8ff8177ba2c6/crypt/debug", "/pool/ext/489724fa-785f-4f35-bb0f-34adf6a09482/crypt/debug", "/pool/ext/a77abd92-fef1-4271-b3d6-7b70ec3d579b/crypt/debug", "/pool/ext/ddc0f818-ddaf-43ed-a26d-e0c1b3bd5e59/crypt/debug", "/pool/ext/42c887d6-10d1-4b8b-a7bb-82239cc2998c/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de
29762025-01-14T22:42:06.437ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 14020183742198588242 n_samples = 6 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
29772025-01-14T22:42:06.486ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
29782025-01-14T22:42:06.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107289 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55145 req_id = f6acc8fc-2d25-41e8-b976-97bdeeb73496 response_code = 204 uri = /switch-ports
29792025-01-14T22:42:06.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 810 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55145 req_id = 14b90d93-e501-400a-b273-210dbf330d1c response_code = 200 uri = /network-bootstore-config
29802025-01-14T22:42:06.523ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
29812025-01-14T22:42:06.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186053 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50794 req_id = 8e9d3374-e9f9-47ff-aa0d-c3404c830e9a response_code = 204 uri = /switch-ports
29822025-01-14T22:42:06.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50794 req_id = 20267e89-7d29-4f6a-a860-4e865f3b1fbd response_code = 200 uri = /network-bootstore-config
29832025-01-14T22:42:07.087ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de", bundle_id: b1e28976-6773-4e4b-94be-ec37633f2a83 }, time_created: 2025-01-14T22:42:06.438440267Z, version: 0, cause: TerminatedInstance }
29842025-01-14T22:42:07.087ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_255c0a6f-b76b-4bc5-b82d-f867181007de file = sled-agent/src/instance.rs:1313 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
29852025-01-14T22:42:08.869ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
29862025-01-14T22:42:08.887ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(15254830), kind: System }
29872025-01-14T22:42:08.887ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(15254830), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
29882025-01-14T22:42:08.887ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-14T22:42:08.887718468Z }, migration_in: None, migration_out: None }
29892025-01-14T22:42:08.914ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-14T22:42:08.887718468Z }, migration_in: None, migration_out: None }
29902025-01-14T22:42:08.919ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1250 instance_id = 0db897ff-2a3c-4240-9e17-233297a4786a propolis_id = 255c0a6f-b76b-4bc5-b82d-f867181007de
29912025-01-14T22:42:09.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32825
29922025-01-14T22:42:09.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32825 req_id = 58bb0800-b6fb-47ed-80de-205a04dac2a0 response_code = 200 uri = /vpc-routes
29932025-01-14T22:42:09.298ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {1d51a386-d2a6-4903-a8ec-2c4496988a60: {10.151.1.175: {b35180cd-43ae-4e39-b2c2-831b0706fe3b}, 10.151.1.176: {b35180cd-43ae-4e39-b2c2-831b0706fe3b}}} }
29942025-01-14T22:42:09.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32825 req_id = d2a7fbea-ed05-4cfb-b365-615c98e34829 response_code = 204 uri = /eip-gateways
29952025-01-14T22:42:09.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35431
29962025-01-14T22:42:09.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35431 req_id = 83d1f684-69d1-49db-b160-711de650d93c response_code = 200 uri = /v2p
29972025-01-14T22:42:09.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32825 req_id = e30791ec-834c-40be-bbcf-cb83a05e676e response_code = 204 uri = /vpc-routes
29982025-01-14T22:42:09.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45219
29992025-01-14T22:42:09.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45219 req_id = b0c32ea8-a4a4-45e8-bd5c-bb06562504e9 response_code = 200 uri = /v2p
30002025-01-14T22:42:09.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37042
30012025-01-14T22:42:09.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37042 req_id = 1e1f5c55-c165-4563-a0a4-3790a2b42a27 response_code = 200 uri = /vpc-routes
30022025-01-14T22:42:09.684ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
30032025-01-14T22:42:09.684ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9
30042025-01-14T22:42:09.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37042 req_id = c276d9de-a461-4ab8-b257-4aac8e30b7fa response_code = 204 uri = /eip-gateways
30052025-01-14T22:42:09.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 409 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37042 req_id = 57be426e-5200-421b-bff8-035c5b257bec response_code = 204 uri = /vpc-routes
30062025-01-14T22:42:10.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44143
30072025-01-14T22:42:10.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44143 req_id = ee57dfda-8a96-45db-af16-60f6e6a3a444 response_code = 200 uri = /vpc-routes
30082025-01-14T22:42:10.483ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 652f7dd4-af0c-42f1-b515-fb2bf74375f9 values = ExternalIpGatewayMap { mappings: {} }
30092025-01-14T22:42:10.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44143 req_id = ed37adb8-9edf-45b5-b3a7-06c6fce51d73 response_code = 204 uri = /eip-gateways
30102025-01-14T22:42:10.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 382 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44143 req_id = 697030bc-4a17-4e6b-ae2a-a7dbc296d06b response_code = 204 uri = /vpc-routes